-- Logs begin at Wed 2022-08-24 07:09:11 UTC, end at Wed 2022-08-24 08:17:56 UTC. -- Aug 24 07:42:49.482131 dv-cinder-852209-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 07:42:49.494745 dv-cinder-852209-7-smb devstack@keystone.service[81772]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:42:49 2022] *** Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: nodename: dv-cinder-852209-7-smb Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: machine: x86_64 Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: clock source: unix Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: pcre jit disabled Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: detected number of CPU cores: 4 Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: current working directory: / Aug 24 07:42:49.496778 dv-cinder-852209-7-smb devstack@keystone.service[81772]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:42:49.497566 dv-cinder-852209-7-smb devstack@keystone.service[81772]: your processes number limit is 47680 Aug 24 07:42:49.497566 dv-cinder-852209-7-smb devstack@keystone.service[81772]: your memory page size is 4096 bytes Aug 24 07:42:49.497566 dv-cinder-852209-7-smb devstack@keystone.service[81772]: detected max file descriptor number: 2048 Aug 24 07:42:49.497566 dv-cinder-852209-7-smb devstack@keystone.service[81772]: lock engine: pthread robust mutexes Aug 24 07:42:49.497566 dv-cinder-852209-7-smb devstack@keystone.service[81772]: thunder lock: enabled Aug 24 07:42:49.497566 dv-cinder-852209-7-smb devstack@keystone.service[81772]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 07:42:49.497566 dv-cinder-852209-7-smb devstack@keystone.service[81772]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:42:49.535738 dv-cinder-852209-7-smb devstack@keystone.service[81772]: Python main interpreter initialized at 0x55d108f529c0 Aug 24 07:42:49.535738 dv-cinder-852209-7-smb devstack@keystone.service[81772]: python threads support enabled Aug 24 07:42:49.535738 dv-cinder-852209-7-smb devstack@keystone.service[81772]: your server socket listen backlog is limited to 100 connections Aug 24 07:42:49.535738 dv-cinder-852209-7-smb devstack@keystone.service[81772]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:42:49.536053 dv-cinder-852209-7-smb devstack@keystone.service[81772]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:42:49.536162 dv-cinder-852209-7-smb devstack@keystone.service[81772]: *** Operational MODE: preforking *** Aug 24 07:42:49.536428 dv-cinder-852209-7-smb devstack@keystone.service[81772]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:42:49.536428 dv-cinder-852209-7-smb devstack@keystone.service[81772]: spawned uWSGI master process (pid: 81772) Aug 24 07:42:49.536622 dv-cinder-852209-7-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 07:42:49.540475 dv-cinder-852209-7-smb devstack@keystone.service[81772]: spawned uWSGI worker 1 (pid: 81783, cores: 1) Aug 24 07:42:49.540475 dv-cinder-852209-7-smb devstack@keystone.service[81772]: spawned uWSGI worker 2 (pid: 81784, cores: 1) Aug 24 07:42:49.540475 dv-cinder-852209-7-smb devstack@keystone.service[81772]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:42:53.885327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:42:53.885327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: from cryptography.utils import int_from_bytes Aug 24 07:42:53.886138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:42:53.886138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: from cryptography.utils import int_from_bytes Aug 24 07:42:53.894373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:42:53.894373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: from cryptography.utils import int_from_bytes Aug 24 07:42:53.894850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:42:53.894850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: from cryptography.utils import int_from_bytes Aug 24 07:42:53.942324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:42:53.942510 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:42:53.942693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] command line args: [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:42:53.942966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:42:53.943050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:42:53.943134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ================================================================================ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:42:53.943214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:42:53.943385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] admin_token = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.943478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] command line args: [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:42:53.943632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] config_dir = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.944214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:42:53.944339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.944473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ================================================================================ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:42:53.944685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] config_source = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.944839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] admin_token = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.944985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] debug = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.945197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.945530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] config_dir = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.945637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.945756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.945860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.945963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] config_source = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.946059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.946248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.946365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] debug = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.946472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.946623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.946757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_config_append = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.946862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.946969 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.947097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_dir = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.947311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.947431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_file = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.947536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.947623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.947742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.947827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.947901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_config_append = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_dir = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_file = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.948994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.949075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.949147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.949289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.949440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.949578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.949709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.949800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.949927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.950004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.950129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.950206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.950331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.950412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.950528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.950612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.950742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.950972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.951054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.951150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] publish_errors = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.951236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.951384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.951469 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.951618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.951702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.951785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.952033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.952167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.952269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.952395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] publish_errors = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.952507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] standard_threads = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.952586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.952739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.952819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.952935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.953009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.953151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.953509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.953588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_journal = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.953673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.953756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_json = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.953834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] standard_threads = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.953906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_stderr = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.953906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_syslog = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.954038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.954110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.954188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.954265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.954335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.954410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_journal = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.954534 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.954619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_json = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.954748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_stderr = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.954827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.954920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_syslog = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.955005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.955150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:42:53.955307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.955404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.955489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.955639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.955723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.955892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.955982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.956128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.956208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.956373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.956457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.956608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.956696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.956853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.956989 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.957088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.957167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.957335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.957421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.957614 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.964512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.964512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.964727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.964814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.964900 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.964975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.965932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.966960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967346 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967796 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.967943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.968958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.969970 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.970076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.970173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.970324 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.970431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.970528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.970633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.970723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.970805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.970925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971389 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971904 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.971974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972485 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.972972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.973954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.974961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.975925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.976930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.977973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978293 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.978929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.979069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.external = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.979149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.979304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.979393 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.979556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.979642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.979782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.external = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.979898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.980004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.980087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.password = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.980265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.token = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.980350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.980502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.980582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.980731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.password = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.980811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.980958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.token = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.981037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.981192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.981273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.981423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.981526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.981690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.981778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.981972 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.982062 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.982141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.982214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.982387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.982468 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.982617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.982698 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.982849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.982929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.983090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.983172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.983332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.983413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.983572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.983652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.983801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.983881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.984039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.984121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.984270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.984351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.984530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.984609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.984778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.984858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.985013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.985093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.985261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.985347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.985550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.985643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.985790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.985869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.986042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.986127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.986273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.986352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.986513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.986593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.986746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.986826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.986979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.987114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.987268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.987360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.987444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.987519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.987673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.987755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.987913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.987993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.988144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.988225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.988389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.988469 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.988617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.988696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.988861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.988941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.989091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.989173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.989334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.989425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.989594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.989677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993215 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.993944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994171 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.994980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995124 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.995931 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996442 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.996972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.997939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998671 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.998970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.999051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.999214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.999296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.999459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.999551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.999685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.999766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.999909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:53.999989 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.000188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.000285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.000432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.000513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.000669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.000748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.000900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.000988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.001132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.001210 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.001357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.001435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.001616 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.001714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.001871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.001951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.002096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.002175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.002338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.002419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.002581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.002660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.002819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.002899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.003049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.003135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.003275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.003355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.003508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.003588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.003739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.003820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.003969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.004090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.004219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.004319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.004468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.004647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.004729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.004802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.004953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.005035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.005202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.005284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.005440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.005554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.005709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.005791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.005952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.006034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.006184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.006814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.006971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.007055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.007206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.007425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.007504 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.007671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.007776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.007911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.008002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.008150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.008285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.008438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.008566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.008694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.008833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.008956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.009081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.009206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.009339 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.009502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.009742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.009877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.010044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.010173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.010307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.010437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.010586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.010713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.010850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.010980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.011111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.011234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.011372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.011500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.011620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.011748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.011880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.012009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.012158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.012292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.012424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.012564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.012696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.012829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.012981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.013116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.013248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.013383 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.013554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.013633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.013722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.013798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] role.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.013870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] role.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.013941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] role.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] role.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014381 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014524 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014881 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.014949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.015022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.015143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.015223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.015387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.015467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.015616 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.015705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.015857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.015932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.016103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.016185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.016348 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.016430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.016590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.016670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.016993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.017072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.017229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.017309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.017487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.017569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.017736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.017816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.017982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.018064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.018231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.018311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.018463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.018546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.018717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.018912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.019004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.019199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.019279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.019432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.019520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.019667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.019748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.019903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.019983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.020156 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.020245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.020400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.020480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.020649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.020728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.020891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.020971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.021126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.021205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.021354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.021433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.021606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.021687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.021899 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.022687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.022780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.022997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.023087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.023247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.023327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.023484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.023603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.023730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.023818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.023972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.024051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.024206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.024286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.024448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.024536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.024687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.024767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.024927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.025005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.025165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.025253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.025419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.025661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.025744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.025916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.026121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.026214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.026454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.026534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.026720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.026818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.026952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.027032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.027197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.027286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.027435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.027514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.027680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.027760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.027918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.028009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.028158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.028239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.028396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.028476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.028634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.028726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.028881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.029119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.029203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.029352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.029443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.029612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.029773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.029852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.029913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.030077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.030158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.030311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.030403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.030540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.030620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.030776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.030905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.031013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.031101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.031177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:42:54.031240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.031471 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.031700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.032173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.032410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:42:54.032578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:42:54.061456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.061710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.061952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.068570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.069299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.069959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.071070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.078489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.102124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.102350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.105823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.106058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.160734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.161360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.212427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.212754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.213133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.213371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.375924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.376159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.376381 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.376600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.376815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.377020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.377159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.377292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.377452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.377690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.377903 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.378115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.401797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.402014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.402217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.402426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.408711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.408711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.409002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.409074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.409150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.409150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.409150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.409150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.409150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.409150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.419955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.420322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.433056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.433279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.433520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.433737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.433946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.434032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.434175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.434391 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.434491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.434681 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.434965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.435247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.435526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.435807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:42:54.451794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.452002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:42:54.452301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.452387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.452524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:42:54.452665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:42:54.452795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.453054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.453134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.453406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:42:54.453589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.453822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.453916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.454206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.454776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.455104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.463349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.466442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.466442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.466442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.466647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.466647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.466647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.466647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.471253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.472774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.474151 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.474439 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.474746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.475067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.475343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.475601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.475866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.476011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.476134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.476302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.476509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.476592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.476781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.476865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.477048 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.477131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.477375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.477675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.477952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.478333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.478611 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.478885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.500109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.501591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.501877 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.502242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.503716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.504000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.507247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.507527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.507807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.509551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.509841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.510125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.514235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.514531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.516519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.516812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.518615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.518907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.519189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.519467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.519739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.520011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.520280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.520546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.520913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.521204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.521510 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.521796 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.522214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.522650 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.522929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.523199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.537733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.538007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.540771 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.541064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.542128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.544988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.545332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.545659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.548207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.548508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.549870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.552717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.553633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.556793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.556889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.562729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.574708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.574993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.575255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.575510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.578123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.578416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.578687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.578954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.582519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.584031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.584311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.586216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.587176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.587463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.587743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.587873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.588016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.588147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.588277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.590667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.590959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.591253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.591548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.591826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.599524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.599808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.600128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.600407 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.600686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.600960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.601353 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.603523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.603813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.604094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.604375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.604651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.604925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.605210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.619063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.621496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.622137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.624536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.625012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.626481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.627466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.627960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.628243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.628530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.628903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.630410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.630700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.630993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.635146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.636600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.638532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.639571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.639886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.640012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.640194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.640509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.643001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.643297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.643592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.643888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.649188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.649487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.649783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.652720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.653016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.653297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.656627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.656919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.657195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.657532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.657812 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.658083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.658354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.658627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.658902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.659176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.659452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.659721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.659979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.660191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:42:54.660327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.660479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.660761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.661037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.661310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.661624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.661902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.662181 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.662477 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.663451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.663871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.664156 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.664447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.664714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:42:54.697870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d108f529c0 pid: 81783 (default app) Aug 24 07:42:54.700211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d108f529c0 pid: 81784 (default app) Aug 24 07:42:54.701274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338222-9203-4628-8469-1b616dad36e5 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:42:54.701587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338222-9203-4628-8469-1b616dad36e5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:42:54.701856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338222-9203-4628-8469-1b616dad36e5 None None] PATH_INFO: `/v3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:42:54.706097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Wed Aug 24 07:42:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:02.197958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd9e5-a2df-4fd1-a3fb-b9997632b429 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:02.198511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd9e5-a2df-4fd1-a3fb-b9997632b429 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:02.198511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dd9e5-a2df-4fd1-a3fb-b9997632b429 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:02.202745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:02.208983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:02.209374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:02.209612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:02.280851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: INFO dbcounter [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] Registered counter for database keystone Aug 24 07:43:02.299944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG oslo_db.sqlalchemy.engines [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:02.306284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writer thread running {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:02.492574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG passlib.handlers.bcrypt [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81783) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 07:43:02.492926 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG passlib.handlers.bcrypt [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81783) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 07:43:02.548220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:02.550002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:02.678247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 07:43:03.163916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd9e5-a2df-4fd1-a3fb-b9997632b429 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:03.233555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: INFO dbcounter [None req-2c1dd9e5-a2df-4fd1-a3fb-b9997632b429 None None] Registered counter for database keystone Aug 24 07:43:03.254972 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG oslo_db.sqlalchemy.engines [None req-2c1dd9e5-a2df-4fd1-a3fb-b9997632b429 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:43:03.261838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writer thread running {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:43:03.381285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dd9e5-a2df-4fd1-a3fb-b9997632b429 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:03.386485 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac7bb9-3b67-45ff-8935-2e64ee8b1a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:03.387105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac7bb9-3b67-45ff-8935-2e64ee8b1a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:03.387384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac7bb9-3b67-45ff-8935-2e64ee8b1a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:03.387655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac7bb9-3b67-45ff-8935-2e64ee8b1a4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:03.395642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac7bb9-3b67-45ff-8935-2e64ee8b1a4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:03.447489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WARNING keystone.common.rbac_enforcer.enforcer [None req-52ac7bb9-3b67-45ff-8935-2e64ee8b1a4a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 07:43:03.447772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac7bb9-3b67-45ff-8935-2e64ee8b1a4a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:03.457198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Wed Aug 24 07:43:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:43:03.463579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:03.478183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f756838-bb34-4ee6-b87a-db5970234ab7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:03.482633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93887af-33d7-42ef-b0c4-365e6acb61da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:03.483724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93887af-33d7-42ef-b0c4-365e6acb61da admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:03.484003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93887af-33d7-42ef-b0c4-365e6acb61da admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:03.484269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93887af-33d7-42ef-b0c4-365e6acb61da admin admin] PATH_INFO: `/v3/projects/28aa92351f744eeb9273dbf7547e3314` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:03.485867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93887af-33d7-42ef-b0c4-365e6acb61da admin admin] RBAC: Authorizing `identity:get_project(project_id=28aa92351f744eeb9273dbf7547e3314)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:03.538579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d93887af-33d7-42ef-b0c4-365e6acb61da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 07:43:03.538922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93887af-33d7-42ef-b0c4-365e6acb61da admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:03.544134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Wed Aug 24 07:43:03 2022] GET /identity/v3/projects/28aa92351f744eeb9273dbf7547e3314 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:05.431448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59152d-a70c-459e-a414-41c99ae0c182 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:05.431959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59152d-a70c-459e-a414-41c99ae0c182 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:05.432046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59152d-a70c-459e-a414-41c99ae0c182 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:05.436024 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:05.441391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a39eb-ffaf-4062-a6ca-78c7ec752a7e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:05.441829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a39eb-ffaf-4062-a6ca-78c7ec752a7e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:05.441960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a39eb-ffaf-4062-a6ca-78c7ec752a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:05.461591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-348a39eb-ffaf-4062-a6ca-78c7ec752a7e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:05.463195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-348a39eb-ffaf-4062-a6ca-78c7ec752a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:05.470853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 07:43:05.736302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59152d-a70c-459e-a414-41c99ae0c182 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:05.748670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59152d-a70c-459e-a414-41c99ae0c182 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:05.752758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd077228-ba6d-44d4-af0b-ffc61834468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:05.753355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd077228-ba6d-44d4-af0b-ffc61834468a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:05.753660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd077228-ba6d-44d4-af0b-ffc61834468a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:05.753929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd077228-ba6d-44d4-af0b-ffc61834468a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:05.762096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd077228-ba6d-44d4-af0b-ffc61834468a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:05.763846 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd077228-ba6d-44d4-af0b-ffc61834468a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:05.772419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Wed Aug 24 07:43:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:43:05.777664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a39eb-ffaf-4062-a6ca-78c7ec752a7e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:05.786641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a39eb-ffaf-4062-a6ca-78c7ec752a7e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:05.791476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb651f-d8dc-40c1-b9a9-2a54283824c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:05.792095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb651f-d8dc-40c1-b9a9-2a54283824c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:05.792370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb651f-d8dc-40c1-b9a9-2a54283824c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:05.792637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb651f-d8dc-40c1-b9a9-2a54283824c9 admin admin] PATH_INFO: `/v3/users/57c499431d554526bf65401b415ad207` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:05.793964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb651f-d8dc-40c1-b9a9-2a54283824c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=57c499431d554526bf65401b415ad207)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:05.795771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb651f-d8dc-40c1-b9a9-2a54283824c9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:05.797290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Wed Aug 24 07:43:05 2022] GET /identity/v3/users/57c499431d554526bf65401b415ad207 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:07.761339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc36842-6b49-4343-9a9b-c595c729ddaf None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:07.761850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc36842-6b49-4343-9a9b-c595c729ddaf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:07.761850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc36842-6b49-4343-9a9b-c595c729ddaf None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:07.763168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:07.768550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3bd2-1d61-487e-a8aa-fb2aa8e5abd9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:07.768919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3bd2-1d61-487e-a8aa-fb2aa8e5abd9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:07.769195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a3bd2-1d61-487e-a8aa-fb2aa8e5abd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:07.787428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a17a3bd2-1d61-487e-a8aa-fb2aa8e5abd9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:07.789666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a17a3bd2-1d61-487e-a8aa-fb2aa8e5abd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:07.817113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7741d-218a-40d4-b772-0ae00e73bfd4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:07.817639 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7741d-218a-40d4-b772-0ae00e73bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:07.817917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7741d-218a-40d4-b772-0ae00e73bfd4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:07.819830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:07.825117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5cc23-eca4-4e86-a213-f8684ef569dd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:07.825491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5cc23-eca4-4e86-a213-f8684ef569dd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:07.825767 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5cc23-eca4-4e86-a213-f8684ef569dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:07.868208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG passlib.handlers.bcrypt [None req-27d5cc23-eca4-4e86-a213-f8684ef569dd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81784) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 07:43:07.868624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG passlib.handlers.bcrypt [None req-27d5cc23-eca4-4e86-a213-f8684ef569dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81784) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 07:43:07.871306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:07.915858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-27d5cc23-eca4-4e86-a213-f8684ef569dd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:07.917452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-27d5cc23-eca4-4e86-a213-f8684ef569dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:08.019876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:08.137823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a3bd2-1d61-487e-a8aa-fb2aa8e5abd9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:08.161906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:08.243480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a3bd2-1d61-487e-a8aa-fb2aa8e5abd9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:08.276218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82f496-ea1e-4fec-8134-aea7fb7991ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:08.276793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82f496-ea1e-4fec-8134-aea7fb7991ff None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:08.277075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82f496-ea1e-4fec-8134-aea7fb7991ff None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:08.277348 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82f496-ea1e-4fec-8134-aea7fb7991ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:08.280981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5cc23-eca4-4e86-a213-f8684ef569dd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:08.289828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82f496-ea1e-4fec-8134-aea7fb7991ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-6a82f496-ea1e-4fec-8134-aea7fb7991ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:08.298150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:08.299179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:08.300066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:08.305484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82f496-ea1e-4fec-8134-aea7fb7991ff None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:08.389312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5cc23-eca4-4e86-a213-f8684ef569dd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:08.391266 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:08.391688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:08.408597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82f496-ea1e-4fec-8134-aea7fb7991ff None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:08.426546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797225a2-39b4-46c1-9960-3996e042b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:08.427393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797225a2-39b4-46c1-9960-3996e042b7da None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:08.427672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797225a2-39b4-46c1-9960-3996e042b7da None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:08.427941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797225a2-39b4-46c1-9960-3996e042b7da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:08.443390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb34a9-a1f7-4b36-9233-9bfb879e8214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:08.447578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb34a9-a1f7-4b36-9233-9bfb879e8214 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:08.447578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb34a9-a1f7-4b36-9233-9bfb879e8214 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:08.447578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb34a9-a1f7-4b36-9233-9bfb879e8214 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:08.447578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb34a9-a1f7-4b36-9233-9bfb879e8214 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:08.447578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb34a9-a1f7-4b36-9233-9bfb879e8214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:08.447578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb34a9-a1f7-4b36-9233-9bfb879e8214 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:08.458983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:08.464598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb34a9-a1f7-4b36-9233-9bfb879e8214 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:08.495781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797225a2-39b4-46c1-9960-3996e042b7da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:08.497292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797225a2-39b4-46c1-9960-3996e042b7da None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:08.563495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb34a9-a1f7-4b36-9233-9bfb879e8214 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:08.592640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:08.597434 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57b5d-3883-4ee4-b2e5-5502fd50c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:08.598087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57b5d-3883-4ee4-b2e5-5502fd50c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:08.598306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797225a2-39b4-46c1-9960-3996e042b7da None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:08.598396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57b5d-3883-4ee4-b2e5-5502fd50c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:08.598618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57b5d-3883-4ee4-b2e5-5502fd50c3d8 None admin] PATH_INFO: `/v3/users/57c499431d554526bf65401b415ad207` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:08.599750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce57b5d-3883-4ee4-b2e5-5502fd50c3d8 None admin] RBAC: Authorizing `identity:get_user(user_id=57c499431d554526bf65401b415ad207)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:08.601834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce57b5d-3883-4ee4-b2e5-5502fd50c3d8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:08.601954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:08.603411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:08 2022] GET /identity/v3/users/57c499431d554526bf65401b415ad207 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:08.608689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57b5d-3883-4ee4-b2e5-5502fd50c3d8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:08.623258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:08.696909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797225a2-39b4-46c1-9960-3996e042b7da None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:08.706708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57b5d-3883-4ee4-b2e5-5502fd50c3d8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:08.732020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99dee8-8a89-4717-87c5-3c00ffde7c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:08.732867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99dee8-8a89-4717-87c5-3c00ffde7c92 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:08.733194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99dee8-8a89-4717-87c5-3c00ffde7c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:08.733480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99dee8-8a89-4717-87c5-3c00ffde7c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:08.741971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e03d-0ef8-42af-90ea-01a300e4eb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:08.742595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e03d-0ef8-42af-90ea-01a300e4eb45 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:08.742873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e03d-0ef8-42af-90ea-01a300e4eb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:08.743143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0e03d-0ef8-42af-90ea-01a300e4eb45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:08.744243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0e03d-0ef8-42af-90ea-01a300e4eb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:08.745712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0e03d-0ef8-42af-90ea-01a300e4eb45 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:08.747249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 10/18] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:08.752095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99dee8-8a89-4717-87c5-3c00ffde7c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:08.753027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e03d-0ef8-42af-90ea-01a300e4eb45 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:08.753572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99dee8-8a89-4717-87c5-3c00ffde7c92 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ce99dee8-8a89-4717-87c5-3c00ffde7c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:43:08.773017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:08.774424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:43:08.775219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:43:08.775219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:43:08.775219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:08.775219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 9/19] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:08.779750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99dee8-8a89-4717-87c5-3c00ffde7c92 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:08.834153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:08.837665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:08.854691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0e03d-0ef8-42af-90ea-01a300e4eb45 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:08.884307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99dee8-8a89-4717-87c5-3c00ffde7c92 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:08.890662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86dc9a-5758-4879-b3c5-a9d974c42230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:08.891268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86dc9a-5758-4879-b3c5-a9d974c42230 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:08.891550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86dc9a-5758-4879-b3c5-a9d974c42230 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:08.891816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86dc9a-5758-4879-b3c5-a9d974c42230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:08.892539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86dc9a-5758-4879-b3c5-a9d974c42230 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.domain.id=default, user.id=57c499431d554526bf65401b415ad207) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:08.892840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86dc9a-5758-4879-b3c5-a9d974c42230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:08.894315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86dc9a-5758-4879-b3c5-a9d974c42230 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:08.913984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 11/20] 10.222.0.58 () {56 vars in 1322 bytes} [Wed Aug 24 07:43:08 2022] GET /identity/v3/role_assignments?user.id=57c499431d554526bf65401b415ad207&scope.domain.id=default&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:08.920144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17c924-92cc-4327-8063-6e6c6312f825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:08.920787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c924-92cc-4327-8063-6e6c6312f825 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:08.921062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c924-92cc-4327-8063-6e6c6312f825 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:08.921330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17c924-92cc-4327-8063-6e6c6312f825 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:08.922032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17c924-92cc-4327-8063-6e6c6312f825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:08.922333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17c924-92cc-4327-8063-6e6c6312f825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:08.923763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17c924-92cc-4327-8063-6e6c6312f825 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:08.945014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 10/21] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:11.046534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b83d0-e266-461c-abf1-65be9cc235fc None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:11.047529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b83d0-e266-461c-abf1-65be9cc235fc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:11.048000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b83d0-e266-461c-abf1-65be9cc235fc None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:11.049943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 12/22] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:11.061692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a8d5-0173-4fa7-aef9-8ec24a7341ef None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:11.062606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a8d5-0173-4fa7-aef9-8ec24a7341ef None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:11.063094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a8d5-0173-4fa7-aef9-8ec24a7341ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:11.085741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3096a8d5-0173-4fa7-aef9-8ec24a7341ef None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:11.087251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3096a8d5-0173-4fa7-aef9-8ec24a7341ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:11.168839 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 11/23] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:11.297697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aec9d-431f-4216-b047-7b98a9f2c2db None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:11.298302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aec9d-431f-4216-b047-7b98a9f2c2db None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:11.298761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aec9d-431f-4216-b047-7b98a9f2c2db None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:11.300277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:11.306092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2748a-be8a-41c8-a7a6-b726fa4cd523 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:11.306381 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2748a-be8a-41c8-a7a6-b726fa4cd523 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:11.306655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2748a-be8a-41c8-a7a6-b726fa4cd523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:11.334588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-94f2748a-be8a-41c8-a7a6-b726fa4cd523 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:11.335923 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-94f2748a-be8a-41c8-a7a6-b726fa4cd523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:11.399555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:11.417149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9d55-6ec3-4d3b-b1e9-bb241d163a07 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:11.417486 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9d55-6ec3-4d3b-b1e9-bb241d163a07 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:11.417721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9d55-6ec3-4d3b-b1e9-bb241d163a07 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:11.419181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 14/25] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:11.424237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591ed03-39ff-427b-b025-488a70556ae3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:11.424521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591ed03-39ff-427b-b025-488a70556ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:11.424794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591ed03-39ff-427b-b025-488a70556ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:11.449590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 12/26] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:11.450458 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6591ed03-39ff-427b-b025-488a70556ae3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:11.451737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6591ed03-39ff-427b-b025-488a70556ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:11.536118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 15/27] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:11.614893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2748a-be8a-41c8-a7a6-b726fa4cd523 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:11.740073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2748a-be8a-41c8-a7a6-b726fa4cd523 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:11.780320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b61db-46eb-4184-bcd5-5bc29d21a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:11.780958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b61db-46eb-4184-bcd5-5bc29d21a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:11.781235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b61db-46eb-4184-bcd5-5bc29d21a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:11.781545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b61db-46eb-4184-bcd5-5bc29d21a1e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:11.802370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b61db-46eb-4184-bcd5-5bc29d21a1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-259b61db-46eb-4184-bcd5-5bc29d21a1e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:11.808827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:11.809721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:11.810468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 13/28] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:11.817284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591ed03-39ff-427b-b025-488a70556ae3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:11.854623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b61db-46eb-4184-bcd5-5bc29d21a1e6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:11.945481 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:11.961938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:11.987678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591ed03-39ff-427b-b025-488a70556ae3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:12.038044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae9ec-57bf-48f7-8a03-975dd1f1fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:12.038760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae9ec-57bf-48f7-8a03-975dd1f1fd50 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.039042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae9ec-57bf-48f7-8a03-975dd1f1fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.039589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae9ec-57bf-48f7-8a03-975dd1f1fd50 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.040319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae9ec-57bf-48f7-8a03-975dd1f1fd50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:12.040619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae9ec-57bf-48f7-8a03-975dd1f1fd50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:12.042178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ae9ec-57bf-48f7-8a03-975dd1f1fd50 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:12.045568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b61db-46eb-4184-bcd5-5bc29d21a1e6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:12.051157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 16/29] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:12.051973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae9ec-57bf-48f7-8a03-975dd1f1fd50 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:12.114224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11dfb9-91b1-4f1e-aa54-852c94d4ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:12.114862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11dfb9-91b1-4f1e-aa54-852c94d4ec35 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.115120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11dfb9-91b1-4f1e-aa54-852c94d4ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.115417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11dfb9-91b1-4f1e-aa54-852c94d4ec35 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.116105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11dfb9-91b1-4f1e-aa54-852c94d4ec35 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:12.117522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11dfb9-91b1-4f1e-aa54-852c94d4ec35 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:12.159826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae9ec-57bf-48f7-8a03-975dd1f1fd50 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:12.197330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc31a52-976d-4bd7-8de5-232f5f7eb62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:12.197923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc31a52-976d-4bd7-8de5-232f5f7eb62d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.198241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc31a52-976d-4bd7-8de5-232f5f7eb62d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.198515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc31a52-976d-4bd7-8de5-232f5f7eb62d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.201460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:12.210695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc31a52-976d-4bd7-8de5-232f5f7eb62d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:12.212284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc31a52-976d-4bd7-8de5-232f5f7eb62d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-cfc31a52-976d-4bd7-8de5-232f5f7eb62d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:43:12.228918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:12.232365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:43:12.234409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:43:12.234409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:43:12.234409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:12.234409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 17/30] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:12.234897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc31a52-976d-4bd7-8de5-232f5f7eb62d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:12.346098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc31a52-976d-4bd7-8de5-232f5f7eb62d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:12.383001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8753-8952-42f5-88ad-855ea4c7b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:12.383633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8753-8952-42f5-88ad-855ea4c7b816 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.384087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8753-8952-42f5-88ad-855ea4c7b816 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.384363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8753-8952-42f5-88ad-855ea4c7b816 None admin] PATH_INFO: `/v3/users/57c499431d554526bf65401b415ad207` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.389487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d8753-8952-42f5-88ad-855ea4c7b816 None admin] RBAC: Authorizing `identity:get_user(user_id=57c499431d554526bf65401b415ad207)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:12.389487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d8753-8952-42f5-88ad-855ea4c7b816 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:12.392354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 18/31] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:12 2022] GET /identity/v3/users/57c499431d554526bf65401b415ad207 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:12.393187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8753-8952-42f5-88ad-855ea4c7b816 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:12.450609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 14/32] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 07:43:11 2022] POST /identity/v3/roles => generated 219 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:12.457668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11dfb9-91b1-4f1e-aa54-852c94d4ec35 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:12.457891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:12.510776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8753-8952-42f5-88ad-855ea4c7b816 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:12.550916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5cc75-ff55-48de-9c31-8fee51dd4b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:12.551882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5cc75-ff55-48de-9c31-8fee51dd4b84 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.552313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5cc75-ff55-48de-9c31-8fee51dd4b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.552776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5cc75-ff55-48de-9c31-8fee51dd4b84 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.554140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5cc75-ff55-48de-9c31-8fee51dd4b84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:12.554595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5cc75-ff55-48de-9c31-8fee51dd4b84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:12.556362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5cc75-ff55-48de-9c31-8fee51dd4b84 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:12.581856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 19/33] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:12.583614 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140f87d-20dc-4932-bf01-67ed94b127c8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.584150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140f87d-20dc-4932-bf01-67ed94b127c8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.585354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140f87d-20dc-4932-bf01-67ed94b127c8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.586912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 20/34] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:12.588927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140f87d-20dc-4932-bf01-67ed94b127c8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:12.647268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:12.656536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11dfb9-91b1-4f1e-aa54-852c94d4ec35 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:12.698674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249087c-5247-40df-b08e-e50e672c3aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:12.699573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249087c-5247-40df-b08e-e50e672c3aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.700016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249087c-5247-40df-b08e-e50e672c3aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.700516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249087c-5247-40df-b08e-e50e672c3aa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.702307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249087c-5247-40df-b08e-e50e672c3aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:12.704078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249087c-5247-40df-b08e-e50e672c3aa4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:12.705133 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140f87d-20dc-4932-bf01-67ed94b127c8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:12.709927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 15/35] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:12.711555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d55e8-80a9-49bd-9cd5-c577925e378d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.712001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d55e8-80a9-49bd-9cd5-c577925e378d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.715357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d55e8-80a9-49bd-9cd5-c577925e378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.725401 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:12.736718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0f3d55e8-80a9-49bd-9cd5-c577925e378d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:12.740793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0f3d55e8-80a9-49bd-9cd5-c577925e378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:12.745342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1f3b9-2fe7-41ea-8e2e-6d5419635f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:12.746000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f3b9-2fe7-41ea-8e2e-6d5419635f3c None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.746283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f3b9-2fe7-41ea-8e2e-6d5419635f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.746707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f3b9-2fe7-41ea-8e2e-6d5419635f3c None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.747440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1f3b9-2fe7-41ea-8e2e-6d5419635f3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:12.748991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1f3b9-2fe7-41ea-8e2e-6d5419635f3c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:12.815096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 16/36] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:12.816116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d55e8-80a9-49bd-9cd5-c577925e378d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:12.926357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:12.933538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d55e8-80a9-49bd-9cd5-c577925e378d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:12.967585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35664de-77f5-4826-9881-167b5cbeb7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:12.968170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35664de-77f5-4826-9881-167b5cbeb7b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.968448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35664de-77f5-4826-9881-167b5cbeb7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.968722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35664de-77f5-4826-9881-167b5cbeb7b8 None admin] PATH_INFO: `/v3/domains/default/users/57c499431d554526bf65401b415ad207/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:12.970913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35664de-77f5-4826-9881-167b5cbeb7b8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=57c499431d554526bf65401b415ad207, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:12.972349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35664de-77f5-4826-9881-167b5cbeb7b8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:12.992827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 21/37] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:43:12 2022] POST /identity/v3/projects => generated 301 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:12.994515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46245e-be23-40d1-a304-6f3b3962b131 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:12.994811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46245e-be23-40d1-a304-6f3b3962b131 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:12.995089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46245e-be23-40d1-a304-6f3b3962b131 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:13.001619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 22/38] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:13.001619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a869-e078-4be8-8cbb-6b1e8ce542ec None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:13.001619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a869-e078-4be8-8cbb-6b1e8ce542ec None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:13.001619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a869-e078-4be8-8cbb-6b1e8ce542ec None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:13.001619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 23/39] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:13.004007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360c2b8-a519-4d65-aff8-bf485dc2c498 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:13.004463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360c2b8-a519-4d65-aff8-bf485dc2c498 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:13.004994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360c2b8-a519-4d65-aff8-bf485dc2c498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:13.027164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0360c2b8-a519-4d65-aff8-bf485dc2c498 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:13.028950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0360c2b8-a519-4d65-aff8-bf485dc2c498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:13.078205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 17/40] 10.222.0.58 () {58 vars in 1361 bytes} [Wed Aug 24 07:43:12 2022] PUT /identity/v3/domains/default/users/57c499431d554526bf65401b415ad207/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:13.079780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698065e-47ff-493a-9ada-e42214116e0f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:13.080134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698065e-47ff-493a-9ada-e42214116e0f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:13.080411 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698065e-47ff-493a-9ada-e42214116e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:13.112485 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d698065e-47ff-493a-9ada-e42214116e0f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:13.114010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d698065e-47ff-493a-9ada-e42214116e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:13.131827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 24/41] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:13.132789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360c2b8-a519-4d65-aff8-bf485dc2c498 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:13.207678 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 18/42] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:13.264196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360c2b8-a519-4d65-aff8-bf485dc2c498 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:13.265811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:13.416314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46dde6-9c89-4fcc-8e56-3ed04604b90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:13.416907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46dde6-9c89-4fcc-8e56-3ed04604b90f None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:13.417191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46dde6-9c89-4fcc-8e56-3ed04604b90f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:13.417488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46dde6-9c89-4fcc-8e56-3ed04604b90f None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:13.418171 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46dde6-9c89-4fcc-8e56-3ed04604b90f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:13.419683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46dde6-9c89-4fcc-8e56-3ed04604b90f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:13.442501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698065e-47ff-493a-9ada-e42214116e0f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:13.494620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 25/43] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 07:43:13 2022] POST /identity/v3/roles => generated 225 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:13.517300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46dde6-9c89-4fcc-8e56-3ed04604b90f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:13.557936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:13.585454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698065e-47ff-493a-9ada-e42214116e0f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:13.637622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46dde6-9c89-4fcc-8e56-3ed04604b90f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:13.638248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8acc1-ff61-413c-9854-d54acae7cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:13.639304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8acc1-ff61-413c-9854-d54acae7cef5 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:13.639984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8acc1-ff61-413c-9854-d54acae7cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:13.640448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8acc1-ff61-413c-9854-d54acae7cef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:13.641834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8acc1-ff61-413c-9854-d54acae7cef5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:13.643252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8acc1-ff61-413c-9854-d54acae7cef5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:13.683413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a0fb-d09e-4aa7-a205-5d6e590b920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:13.684076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a0fb-d09e-4aa7-a205-5d6e590b920e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:13.684357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a0fb-d09e-4aa7-a205-5d6e590b920e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:13.684631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7a0fb-d09e-4aa7-a205-5d6e590b920e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:13.685884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7a0fb-d09e-4aa7-a205-5d6e590b920e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:13.687383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7a0fb-d09e-4aa7-a205-5d6e590b920e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:13.688960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 26/44] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:13.695606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a0fb-d09e-4aa7-a205-5d6e590b920e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:13.725137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:13.729320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 19/45] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 07:43:13 2022] POST /identity/v3/roles => generated 223 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:43:13.808257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7a0fb-d09e-4aa7-a205-5d6e590b920e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:13.847526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaad0e-535b-4bdb-a905-a38eb4760149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:13.848151 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaad0e-535b-4bdb-a905-a38eb4760149 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:13.848433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaad0e-535b-4bdb-a905-a38eb4760149 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:13.848707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaad0e-535b-4bdb-a905-a38eb4760149 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:13.849379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaad0e-535b-4bdb-a905-a38eb4760149 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:13.851026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaad0e-535b-4bdb-a905-a38eb4760149 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:13.967656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 27/46] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:43:13 2022] POST /identity/v3/projects => generated 312 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:43:15.185213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439c1f-01ed-4e9d-b465-dbf1455f15db None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:15.185746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439c1f-01ed-4e9d-b465-dbf1455f15db None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:15.185851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439c1f-01ed-4e9d-b465-dbf1455f15db None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:15.187119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 20/47] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:15.192398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e14b7-58be-4f7f-b1b0-67ae70eef4e7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:15.192789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e14b7-58be-4f7f-b1b0-67ae70eef4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:15.192959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e14b7-58be-4f7f-b1b0-67ae70eef4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:15.210554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7c9e14b7-58be-4f7f-b1b0-67ae70eef4e7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:15.211727 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7c9e14b7-58be-4f7f-b1b0-67ae70eef4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:15.276953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 28/48] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:15.548952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db439c1f-01ed-4e9d-b465-dbf1455f15db None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:15.650027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db439c1f-01ed-4e9d-b465-dbf1455f15db None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:15.683254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8597a-4785-432a-8f71-10ec04237838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:15.683880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8597a-4785-432a-8f71-10ec04237838 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:15.684159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8597a-4785-432a-8f71-10ec04237838 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:15.684431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8597a-4785-432a-8f71-10ec04237838 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:15.694850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8597a-4785-432a-8f71-10ec04237838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-4de8597a-4785-432a-8f71-10ec04237838 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:15.699999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:15.700934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:15.701759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 21/49] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:15.706899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e14b7-58be-4f7f-b1b0-67ae70eef4e7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:15.717722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:15.806482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e14b7-58be-4f7f-b1b0-67ae70eef4e7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:15.840798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4899-e08b-4734-931c-25df14f0bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:15.841411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4899-e08b-4734-931c-25df14f0bea3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:15.841725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4899-e08b-4734-931c-25df14f0bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:15.842003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4899-e08b-4734-931c-25df14f0bea3 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:15.842680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4899-e08b-4734-931c-25df14f0bea3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:15.842983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4899-e08b-4734-931c-25df14f0bea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:15.844514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4899-e08b-4734-931c-25df14f0bea3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:15.852555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 29/50] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:15.858155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8597a-4785-432a-8f71-10ec04237838 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:15.862222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:15.862616 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9da7-c1d2-47d5-8ec7-8dbcf323f18b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:15.862911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9da7-c1d2-47d5-8ec7-8dbcf323f18b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:15.863191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9da7-c1d2-47d5-8ec7-8dbcf323f18b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:15.864508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 30/51] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:15.869777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695b160-e7fa-4eb6-88a1-8fe5e2881cc6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:15.872137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695b160-e7fa-4eb6-88a1-8fe5e2881cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:15.872137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695b160-e7fa-4eb6-88a1-8fe5e2881cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:15.889289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7695b160-e7fa-4eb6-88a1-8fe5e2881cc6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:15.890688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7695b160-e7fa-4eb6-88a1-8fe5e2881cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:15.953436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:15.958335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 31/52] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:15.963099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8597a-4785-432a-8f71-10ec04237838 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:15.996299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e8c9b-e7c5-4951-92b0-26c419879972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:15.996929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8c9b-e7c5-4951-92b0-26c419879972 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:15.997208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8c9b-e7c5-4951-92b0-26c419879972 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:15.997513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8c9b-e7c5-4951-92b0-26c419879972 None admin] PATH_INFO: `/v3/users/57c499431d554526bf65401b415ad207` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:15.998649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e8c9b-e7c5-4951-92b0-26c419879972 None admin] RBAC: Authorizing `identity:get_user(user_id=57c499431d554526bf65401b415ad207)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:16.000111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e8c9b-e7c5-4951-92b0-26c419879972 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:16.001719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 22/53] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:15 2022] GET /identity/v3/users/57c499431d554526bf65401b415ad207 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:16.007853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695b160-e7fa-4eb6-88a1-8fe5e2881cc6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:16.105627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695b160-e7fa-4eb6-88a1-8fe5e2881cc6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:16.138963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3941f-e6b3-4401-8cf9-d30f1af6cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:16.139589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3941f-e6b3-4401-8cf9-d30f1af6cd13 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:16.139870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3941f-e6b3-4401-8cf9-d30f1af6cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:16.140142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3941f-e6b3-4401-8cf9-d30f1af6cd13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:16.141252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3941f-e6b3-4401-8cf9-d30f1af6cd13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:16.142757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3941f-e6b3-4401-8cf9-d30f1af6cd13 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:16.144321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 32/54] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:16.150103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e8c9b-e7c5-4951-92b0-26c419879972 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:16.220996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:16.229395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3941f-e6b3-4401-8cf9-d30f1af6cd13 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:16.251749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e8c9b-e7c5-4951-92b0-26c419879972 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:16.285744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e6ada-10b7-456f-937a-e7b18ab10dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:16.286348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e6ada-10b7-456f-937a-e7b18ab10dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:16.286628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e6ada-10b7-456f-937a-e7b18ab10dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:16.286900 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e6ada-10b7-456f-937a-e7b18ab10dc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:16.287647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e6ada-10b7-456f-937a-e7b18ab10dc4 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.domain.id=default, user.id=57c499431d554526bf65401b415ad207) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:16.287946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e6ada-10b7-456f-937a-e7b18ab10dc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:16.289655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e6ada-10b7-456f-937a-e7b18ab10dc4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:16.296886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:16.297261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 23/55] 10.222.0.58 () {56 vars in 1322 bytes} [Wed Aug 24 07:43:16 2022] GET /identity/v3/role_assignments?user.id=57c499431d554526bf65401b415ad207&scope.domain.id=default&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:16.336212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3941f-e6b3-4401-8cf9-d30f1af6cd13 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:16.374545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab2e3-eec0-45de-9c3d-dfe9e7091f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:16.375195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab2e3-eec0-45de-9c3d-dfe9e7091f82 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:16.375470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab2e3-eec0-45de-9c3d-dfe9e7091f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:16.375741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab2e3-eec0-45de-9c3d-dfe9e7091f82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:16.376921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ab2e3-eec0-45de-9c3d-dfe9e7091f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:16.378381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ab2e3-eec0-45de-9c3d-dfe9e7091f82 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:16.379992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 33/56] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:16.386524 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e6ada-10b7-456f-937a-e7b18ab10dc4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:16.492898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e6ada-10b7-456f-937a-e7b18ab10dc4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:16.525965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e0e8d-3d1f-44f3-841d-633e40d27a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:16.526582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e0e8d-3d1f-44f3-841d-633e40d27a37 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:16.526866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e0e8d-3d1f-44f3-841d-633e40d27a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:16.527143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e0e8d-3d1f-44f3-841d-633e40d27a37 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:16.527783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e0e8d-3d1f-44f3-841d-633e40d27a37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:16.529231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e0e8d-3d1f-44f3-841d-633e40d27a37 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:16.534794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:16.635635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 24/57] 10.222.0.58 () {60 vars in 1140 bytes} [Wed Aug 24 07:43:16 2022] POST /identity/v3/projects => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:18.543458 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9b5df-f03b-4558-b064-587d23c09042 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:18.543967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9b5df-f03b-4558-b064-587d23c09042 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:18.543967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9b5df-f03b-4558-b064-587d23c09042 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:18.545318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 34/58] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:18.550474 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea410f9-22b5-4509-a359-90de90c2d59b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:18.550881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea410f9-22b5-4509-a359-90de90c2d59b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:18.551043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea410f9-22b5-4509-a359-90de90c2d59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:18.671806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2ea410f9-22b5-4509-a359-90de90c2d59b None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:18.672954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2ea410f9-22b5-4509-a359-90de90c2d59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:18.739253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 25/59] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:19.007425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9b5df-f03b-4558-b064-587d23c09042 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:19.105590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9b5df-f03b-4558-b064-587d23c09042 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:19.138214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc2567-48a0-408a-8cb2-9cc659737c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:19.138830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc2567-48a0-408a-8cb2-9cc659737c18 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:19.139105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc2567-48a0-408a-8cb2-9cc659737c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:19.139372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc2567-48a0-408a-8cb2-9cc659737c18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:19.140465 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc2567-48a0-408a-8cb2-9cc659737c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:19.141918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc2567-48a0-408a-8cb2-9cc659737c18 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:19.143450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 35/60] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:19.149154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea410f9-22b5-4509-a359-90de90c2d59b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:19.245535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea410f9-22b5-4509-a359-90de90c2d59b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:19.262830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:19.278776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeb9f7-7a95-4b4e-83a5-4cb3e072fa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:19.279375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeb9f7-7a95-4b4e-83a5-4cb3e072fa9c None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:19.281781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeb9f7-7a95-4b4e-83a5-4cb3e072fa9c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:19.281781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeb9f7-7a95-4b4e-83a5-4cb3e072fa9c None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:19.281781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeb9f7-7a95-4b4e-83a5-4cb3e072fa9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:19.281998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeb9f7-7a95-4b4e-83a5-4cb3e072fa9c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:19.435273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 26/61] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:43:19 2022] POST /identity/v3/users => generated 275 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:22.347649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adb86d-fe9f-468c-b332-6ff2f6de5b01 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:22.348204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adb86d-fe9f-468c-b332-6ff2f6de5b01 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:22.348204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adb86d-fe9f-468c-b332-6ff2f6de5b01 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:22.350282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 36/62] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:22.365517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e90b46-10f5-4b8a-aa51-173023390f22 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:22.365896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e90b46-10f5-4b8a-aa51-173023390f22 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:22.366061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e90b46-10f5-4b8a-aa51-173023390f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:22.405777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d3e90b46-10f5-4b8a-aa51-173023390f22 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:22.407127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d3e90b46-10f5-4b8a-aa51-173023390f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:22.504988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 27/63] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:22.661225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8ea14-2602-49be-9bf7-4fa288c90838 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:22.662078 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8ea14-2602-49be-9bf7-4fa288c90838 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:22.662572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8ea14-2602-49be-9bf7-4fa288c90838 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:22.664371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 37/64] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:22.670158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9cd9f-c10c-40e8-9a86-c7412ebf7d0a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:22.670683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9cd9f-c10c-40e8-9a86-c7412ebf7d0a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:22.671162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9cd9f-c10c-40e8-9a86-c7412ebf7d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:22.689410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-bbe9cd9f-c10c-40e8-9a86-c7412ebf7d0a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:22.690957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bbe9cd9f-c10c-40e8-9a86-c7412ebf7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:22.755973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c3cfe-e3eb-4a5a-aa9a-5701c955e36e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:22.756576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c3cfe-e3eb-4a5a-aa9a-5701c955e36e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:22.757102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c3cfe-e3eb-4a5a-aa9a-5701c955e36e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:22.758690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 38/65] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:22.764457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fff883-1d29-4310-b76f-22a1c935f238 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:22.765004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fff883-1d29-4310-b76f-22a1c935f238 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:22.765522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fff883-1d29-4310-b76f-22a1c935f238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:22.773794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:22.793237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-59fff883-1d29-4310-b76f-22a1c935f238 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:22.794487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-59fff883-1d29-4310-b76f-22a1c935f238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:22.810897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 28/66] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:22.864074 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9cd9f-c10c-40e8-9a86-c7412ebf7d0a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:22.929841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 39/67] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:22.930010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.006267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9cd9f-c10c-40e8-9a86-c7412ebf7d0a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.045131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfba7c-4db8-4989-978c-763716445695 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.045452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfba7c-4db8-4989-978c-763716445695 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.045706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfba7c-4db8-4989-978c-763716445695 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.047187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 40/68] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:23.055339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194cb02-3806-4914-89a8-6690b34af215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.056209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194cb02-3806-4914-89a8-6690b34af215 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.056639 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194cb02-3806-4914-89a8-6690b34af215 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.057105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194cb02-3806-4914-89a8-6690b34af215 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.058922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2aa4-8358-4339-a6ac-21e9e6f002f2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.059341 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2aa4-8358-4339-a6ac-21e9e6f002f2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.059743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb2aa4-8358-4339-a6ac-21e9e6f002f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.084974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f2fb2aa4-8358-4339-a6ac-21e9e6f002f2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:23.088218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f2fb2aa4-8358-4339-a6ac-21e9e6f002f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:23.090055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194cb02-3806-4914-89a8-6690b34af215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6194cb02-3806-4914-89a8-6690b34af215 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:23.096328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:23.097369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:23.098348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:23.101679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 29/69] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:23.107587 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194cb02-3806-4914-89a8-6690b34af215 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:23.180436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 41/70] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:23.181962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f6ff-f73f-4bc4-92e6-15939279f95f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.182460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f6ff-f73f-4bc4-92e6-15939279f95f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.182854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f6ff-f73f-4bc4-92e6-15939279f95f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.184213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 42/71] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:23.185043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8f6ff-f73f-4bc4-92e6-15939279f95f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:23.212344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.219600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194cb02-3806-4914-89a8-6690b34af215 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.256002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.263133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e61259-9f3b-4432-a3f1-08c19fd12418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.264633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e61259-9f3b-4432-a3f1-08c19fd12418 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.264924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e61259-9f3b-4432-a3f1-08c19fd12418 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.265260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e61259-9f3b-4432-a3f1-08c19fd12418 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.266033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e61259-9f3b-4432-a3f1-08c19fd12418 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:23.266347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e61259-9f3b-4432-a3f1-08c19fd12418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:23.267849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e61259-9f3b-4432-a3f1-08c19fd12418 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:23.287945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 30/72] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:23.287945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab04ac1-34ef-4ae3-ac1d-fbad19c1195e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.287945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab04ac1-34ef-4ae3-ac1d-fbad19c1195e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.287945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab04ac1-34ef-4ae3-ac1d-fbad19c1195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.296463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8f6ff-f73f-4bc4-92e6-15939279f95f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.305684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-aab04ac1-34ef-4ae3-ac1d-fbad19c1195e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:23.306896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aab04ac1-34ef-4ae3-ac1d-fbad19c1195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:23.340894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c10779-f824-4ece-95e7-6ef8ff20624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.341834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10779-f824-4ece-95e7-6ef8ff20624f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.342288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10779-f824-4ece-95e7-6ef8ff20624f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.342751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c10779-f824-4ece-95e7-6ef8ff20624f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.354039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c10779-f824-4ece-95e7-6ef8ff20624f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-34c10779-f824-4ece-95e7-6ef8ff20624f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:23.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:23.361026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:23.361809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:23.363131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 43/73] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:43:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:23.363778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c10779-f824-4ece-95e7-6ef8ff20624f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:23.389064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 31/74] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:23.390446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab04ac1-34ef-4ae3-ac1d-fbad19c1195e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:23.488164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c10779-f824-4ece-95e7-6ef8ff20624f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.488964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.504668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab04ac1-34ef-4ae3-ac1d-fbad19c1195e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.512531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.524003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e6a4-1bf9-409f-9808-744591125fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.524631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e6a4-1bf9-409f-9808-744591125fef None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.524905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e6a4-1bf9-409f-9808-744591125fef None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.525171 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e6a4-1bf9-409f-9808-744591125fef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.535932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689e6a4-1bf9-409f-9808-744591125fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7689e6a4-1bf9-409f-9808-744591125fef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:23.541824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:23.570345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:23.571289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:23.572004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369bdaf-7c73-4697-8f1a-83d02e881795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.572004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bdaf-7c73-4697-8f1a-83d02e881795 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.572162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 44/75] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:23.572237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bdaf-7c73-4697-8f1a-83d02e881795 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.572237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369bdaf-7c73-4697-8f1a-83d02e881795 None admin] PATH_INFO: `/v3/users/7d7ee37393394dd29269a36ed2bfd07c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.572383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e6a4-1bf9-409f-9808-744591125fef None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:23.572457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369bdaf-7c73-4697-8f1a-83d02e881795 None admin] RBAC: Authorizing `identity:get_user(user_id=7d7ee37393394dd29269a36ed2bfd07c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:23.572457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369bdaf-7c73-4697-8f1a-83d02e881795 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:23.572457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 32/76] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:23 2022] GET /identity/v3/users/7d7ee37393394dd29269a36ed2bfd07c => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:23.572457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369bdaf-7c73-4697-8f1a-83d02e881795 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:23.657690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e6a4-1bf9-409f-9808-744591125fef None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.672742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369bdaf-7c73-4697-8f1a-83d02e881795 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.695815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f37e1-c64e-44b1-ba98-4aa6abb452ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.696452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f37e1-c64e-44b1-ba98-4aa6abb452ea None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.696731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f37e1-c64e-44b1-ba98-4aa6abb452ea None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.697009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f37e1-c64e-44b1-ba98-4aa6abb452ea None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.697709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f37e1-c64e-44b1-ba98-4aa6abb452ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:23.698015 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f37e1-c64e-44b1-ba98-4aa6abb452ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:23.699397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f37e1-c64e-44b1-ba98-4aa6abb452ea None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:23.707137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 45/77] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:43:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:23.707315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a1a09-0d95-40b6-a6d8-5ce8a8e5a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.708033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a1a09-0d95-40b6-a6d8-5ce8a8e5a502 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.708320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a1a09-0d95-40b6-a6d8-5ce8a8e5a502 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.708418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f37e1-c64e-44b1-ba98-4aa6abb452ea None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:23.708631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a1a09-0d95-40b6-a6d8-5ce8a8e5a502 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.712332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a1a09-0d95-40b6-a6d8-5ce8a8e5a502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:23.713790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a1a09-0d95-40b6-a6d8-5ce8a8e5a502 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:23.715353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 33/78] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:23.720429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a1a09-0d95-40b6-a6d8-5ce8a8e5a502 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:23.734754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.759304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.809027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f37e1-c64e-44b1-ba98-4aa6abb452ea None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.821046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a1a09-0d95-40b6-a6d8-5ce8a8e5a502 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.842678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32969f-afc8-413c-b093-6ba80d23a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.843277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32969f-afc8-413c-b093-6ba80d23a536 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.843553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32969f-afc8-413c-b093-6ba80d23a536 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.843821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32969f-afc8-413c-b093-6ba80d23a536 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.844478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32969f-afc8-413c-b093-6ba80d23a536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:23.844777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32969f-afc8-413c-b093-6ba80d23a536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:23.846176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32969f-afc8-413c-b093-6ba80d23a536 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:23.854113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388b57-fc2f-45a2-9dc8-3d286af74718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.859011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 46/79] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:23.859141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388b57-fc2f-45a2-9dc8-3d286af74718 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.859141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388b57-fc2f-45a2-9dc8-3d286af74718 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.859141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388b57-fc2f-45a2-9dc8-3d286af74718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:23.859372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32969f-afc8-413c-b093-6ba80d23a536 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:23.922136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64388b57-fc2f-45a2-9dc8-3d286af74718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:23.923600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64388b57-fc2f-45a2-9dc8-3d286af74718 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:23.936711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.955693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32969f-afc8-413c-b093-6ba80d23a536 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:23.965407 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.989438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90fa45-52d8-430b-a53e-d93b3447d954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:23.990137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90fa45-52d8-430b-a53e-d93b3447d954 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:23.990413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90fa45-52d8-430b-a53e-d93b3447d954 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:23.990687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90fa45-52d8-430b-a53e-d93b3447d954 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:24.002040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90fa45-52d8-430b-a53e-d93b3447d954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ea90fa45-52d8-430b-a53e-d93b3447d954 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:24.007799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:24.008664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:24.009508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 47/80] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:24.014279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90fa45-52d8-430b-a53e-d93b3447d954 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:24.026158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 34/81] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:24.026158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388b57-fc2f-45a2-9dc8-3d286af74718 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:24.116175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90fa45-52d8-430b-a53e-d93b3447d954 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:24.121956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388b57-fc2f-45a2-9dc8-3d286af74718 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:24.134346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:24.149396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ec222-d8cd-4e40-8edd-4841cec6d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:24.150134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec222-d8cd-4e40-8edd-4841cec6d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:24.150483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec222-d8cd-4e40-8edd-4841cec6d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:24.150766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ec222-d8cd-4e40-8edd-4841cec6d9a4 None admin] PATH_INFO: `/v3/users/7d7ee37393394dd29269a36ed2bfd07c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:24.151895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ec222-d8cd-4e40-8edd-4841cec6d9a4 None admin] RBAC: Authorizing `identity:get_user(user_id=7d7ee37393394dd29269a36ed2bfd07c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:24.153347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ec222-d8cd-4e40-8edd-4841cec6d9a4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:24.154957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 48/82] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:24 2022] GET /identity/v3/users/7d7ee37393394dd29269a36ed2bfd07c => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:24.155075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c36ed-9fdf-4f66-b859-5583317ae14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:24.155673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c36ed-9fdf-4f66-b859-5583317ae14b None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:24.155771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ec222-d8cd-4e40-8edd-4841cec6d9a4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:24.156036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c36ed-9fdf-4f66-b859-5583317ae14b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:24.156408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c36ed-9fdf-4f66-b859-5583317ae14b None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:24.157047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c36ed-9fdf-4f66-b859-5583317ae14b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:24.158707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c36ed-9fdf-4f66-b859-5583317ae14b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:24.191166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:24.246150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 35/83] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:43:24 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:24.246977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c36ed-9fdf-4f66-b859-5583317ae14b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:24.254820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ec222-d8cd-4e40-8edd-4841cec6d9a4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:24.297445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028125b4-d3ef-4d3f-b716-79a191d45680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:24.298078 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028125b4-d3ef-4d3f-b716-79a191d45680 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:24.298412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028125b4-d3ef-4d3f-b716-79a191d45680 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:24.298694 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028125b4-d3ef-4d3f-b716-79a191d45680 None admin] PATH_INFO: `/v3/users/57c499431d554526bf65401b415ad207` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:24.299958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028125b4-d3ef-4d3f-b716-79a191d45680 None admin] RBAC: Authorizing `identity:get_user(user_id=57c499431d554526bf65401b415ad207)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:24.301451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028125b4-d3ef-4d3f-b716-79a191d45680 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:24.308015 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 49/84] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:24 2022] GET /identity/v3/users/57c499431d554526bf65401b415ad207 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:24.308015 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028125b4-d3ef-4d3f-b716-79a191d45680 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:24.377181 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c36ed-9fdf-4f66-b859-5583317ae14b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:24.426399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028125b4-d3ef-4d3f-b716-79a191d45680 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:24.429578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:24.448096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ea609-35ab-42ba-aa21-41c789f73db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:24.449860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ea609-35ab-42ba-aa21-41c789f73db4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:24.450147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ea609-35ab-42ba-aa21-41c789f73db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:24.450449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ea609-35ab-42ba-aa21-41c789f73db4 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:24.451124 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ea609-35ab-42ba-aa21-41c789f73db4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:24.451436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ea609-35ab-42ba-aa21-41c789f73db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:24.452835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ea609-35ab-42ba-aa21-41c789f73db4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:24.464508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 36/85] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:24.465863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ea609-35ab-42ba-aa21-41c789f73db4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:24.473485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93320d6e-2dcc-4a33-b71a-afd52a32091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:24.474742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93320d6e-2dcc-4a33-b71a-afd52a32091a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:24.475041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93320d6e-2dcc-4a33-b71a-afd52a32091a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:24.475317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93320d6e-2dcc-4a33-b71a-afd52a32091a None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:24.476613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93320d6e-2dcc-4a33-b71a-afd52a32091a None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:24.479863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93320d6e-2dcc-4a33-b71a-afd52a32091a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:24.480448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 50/86] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:24 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:24.481421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93320d6e-2dcc-4a33-b71a-afd52a32091a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:24.502629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:24.597345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ea609-35ab-42ba-aa21-41c789f73db4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:24.602618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93320d6e-2dcc-4a33-b71a-afd52a32091a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:24.641776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0e94-7123-4610-83c5-8e6ef97ff1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:24.642411 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0e94-7123-4610-83c5-8e6ef97ff1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:24.642680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0e94-7123-4610-83c5-8e6ef97ff1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:24.642956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0e94-7123-4610-83c5-8e6ef97ff1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:24.644630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ea19-d5e0-44a2-b976-cb60d7f47140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:24.645664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ea19-d5e0-44a2-b976-cb60d7f47140 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:24.646680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ea19-d5e0-44a2-b976-cb60d7f47140 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:24.648626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1ea19-d5e0-44a2-b976-cb60d7f47140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:24.703760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:24.722010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd0e94-7123-4610-83c5-8e6ef97ff1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:24.723506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd0e94-7123-4610-83c5-8e6ef97ff1e1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:24.747077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ea19-d5e0-44a2-b976-cb60d7f47140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:24.748978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1ea19-d5e0-44a2-b976-cb60d7f47140 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:24.769874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:24.835270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 37/87] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:24.836785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0e94-7123-4610-83c5-8e6ef97ff1e1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:24.865651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 51/88] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:24.866641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ea19-d5e0-44a2-b976-cb60d7f47140 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:24.954558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:24.964859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0e94-7123-4610-83c5-8e6ef97ff1e1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:24.985895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1ea19-d5e0-44a2-b976-cb60d7f47140 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:25.003499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:25.012199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99a8d-1572-48de-b0de-fed1f4e436f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:25.013246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99a8d-1572-48de-b0de-fed1f4e436f6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:25.013555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99a8d-1572-48de-b0de-fed1f4e436f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:25.013834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e99a8d-1572-48de-b0de-fed1f4e436f6 None admin] PATH_INFO: `/v3/users/7d7ee37393394dd29269a36ed2bfd07c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:25.015487 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e99a8d-1572-48de-b0de-fed1f4e436f6 None admin] RBAC: Authorizing `identity:get_user(user_id=7d7ee37393394dd29269a36ed2bfd07c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:25.017623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e99a8d-1572-48de-b0de-fed1f4e436f6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:25.019282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 38/89] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:24 2022] GET /identity/v3/users/7d7ee37393394dd29269a36ed2bfd07c => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:25.020177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99a8d-1572-48de-b0de-fed1f4e436f6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:25.030150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279e359-8d3a-4714-8213-1aa4972d1dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:25.031144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279e359-8d3a-4714-8213-1aa4972d1dbd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:25.031641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279e359-8d3a-4714-8213-1aa4972d1dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:25.032175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279e359-8d3a-4714-8213-1aa4972d1dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:25.033117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279e359-8d3a-4714-8213-1aa4972d1dbd None admin] RBAC: Adding query filter params (role.id=a9232505007a45c580ef9414aee94847, scope.project.id=b5171171f9c44ffe896d40e40391d4a1, user.id=7d7ee37393394dd29269a36ed2bfd07c) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:25.033652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279e359-8d3a-4714-8213-1aa4972d1dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:25.036573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279e359-8d3a-4714-8213-1aa4972d1dbd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:25.045837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 52/90] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:24 2022] GET /identity/v3/role_assignments?user.id=7d7ee37393394dd29269a36ed2bfd07c&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=a9232505007a45c580ef9414aee94847 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:25.047363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279e359-8d3a-4714-8213-1aa4972d1dbd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:25.180018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279e359-8d3a-4714-8213-1aa4972d1dbd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:25.221841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed52b73-c0f6-47d9-9cc6-84e82ceb1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:25.222817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed52b73-c0f6-47d9-9cc6-84e82ceb1fdc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:25.223546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed52b73-c0f6-47d9-9cc6-84e82ceb1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:25.223991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed52b73-c0f6-47d9-9cc6-84e82ceb1fdc None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:25.226302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed52b73-c0f6-47d9-9cc6-84e82ceb1fdc None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:25.227953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed52b73-c0f6-47d9-9cc6-84e82ceb1fdc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:25.230397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 53/91] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:25 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:25.231844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed52b73-c0f6-47d9-9cc6-84e82ceb1fdc None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:25.236023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:25.274008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e99a8d-1572-48de-b0de-fed1f4e436f6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:25.355332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed52b73-c0f6-47d9-9cc6-84e82ceb1fdc None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:25.371552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83ea96-f0f9-41d6-acd1-259cfb9c2fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:25.372214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ea96-f0f9-41d6-acd1-259cfb9c2fdf None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:25.372500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ea96-f0f9-41d6-acd1-259cfb9c2fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:25.372792 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ea96-f0f9-41d6-acd1-259cfb9c2fdf None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:25.377754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83ea96-f0f9-41d6-acd1-259cfb9c2fdf None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:25.379272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83ea96-f0f9-41d6-acd1-259cfb9c2fdf None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:25.381714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 39/92] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:25 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:25.382491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83ea96-f0f9-41d6-acd1-259cfb9c2fdf None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:25.396927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300baef7-a738-4bfd-ba46-6bf8ae9d3c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:25.397548 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300baef7-a738-4bfd-ba46-6bf8ae9d3c8c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:25.397829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300baef7-a738-4bfd-ba46-6bf8ae9d3c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:25.398103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300baef7-a738-4bfd-ba46-6bf8ae9d3c8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:25.478791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300baef7-a738-4bfd-ba46-6bf8ae9d3c8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:25.481327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300baef7-a738-4bfd-ba46-6bf8ae9d3c8c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:25.484258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:25.522931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:25.598184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83ea96-f0f9-41d6-acd1-259cfb9c2fdf None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:25.616330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 54/93] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:25.617287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300baef7-a738-4bfd-ba46-6bf8ae9d3c8c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:25.688447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877ffc0-d107-472c-9319-ae67f6f9b727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:25.689072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877ffc0-d107-472c-9319-ae67f6f9b727 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:25.689359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877ffc0-d107-472c-9319-ae67f6f9b727 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:25.689679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877ffc0-d107-472c-9319-ae67f6f9b727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:25.690422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877ffc0-d107-472c-9319-ae67f6f9b727 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=b5171171f9c44ffe896d40e40391d4a1, user.id=57c499431d554526bf65401b415ad207) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:25.690734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877ffc0-d107-472c-9319-ae67f6f9b727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:25.692391 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877ffc0-d107-472c-9319-ae67f6f9b727 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:25.710278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 40/94] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:25 2022] GET /identity/v3/role_assignments?user.id=57c499431d554526bf65401b415ad207&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:25.711182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877ffc0-d107-472c-9319-ae67f6f9b727 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:25.741318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300baef7-a738-4bfd-ba46-6bf8ae9d3c8c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:25.750191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:25.784070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37c697-5499-4fa2-9ed9-879b4da941d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:25.784693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37c697-5499-4fa2-9ed9-879b4da941d7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:25.784977 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37c697-5499-4fa2-9ed9-879b4da941d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:25.785255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37c697-5499-4fa2-9ed9-879b4da941d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:25.786032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37c697-5499-4fa2-9ed9-879b4da941d7 None admin] RBAC: Adding query filter params (role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=b5171171f9c44ffe896d40e40391d4a1, user.id=7d7ee37393394dd29269a36ed2bfd07c) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:25.786350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37c697-5499-4fa2-9ed9-879b4da941d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:25.789277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37c697-5499-4fa2-9ed9-879b4da941d7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:25.796508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 55/95] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:25 2022] GET /identity/v3/role_assignments?user.id=7d7ee37393394dd29269a36ed2bfd07c&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:25.884781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877ffc0-d107-472c-9319-ae67f6f9b727 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:25.918152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:25.925000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b3adc-97b3-4e8d-9104-7a97468d48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:25.925692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3adc-97b3-4e8d-9104-7a97468d48ed None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:25.925975 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3adc-97b3-4e8d-9104-7a97468d48ed None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:25.926249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3adc-97b3-4e8d-9104-7a97468d48ed None admin] PATH_INFO: `/v3/projects/d780990040124f46b85f1356627ea778` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:25.927491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b3adc-97b3-4e8d-9104-7a97468d48ed None admin] RBAC: Authorizing `identity:get_project(project_id=d780990040124f46b85f1356627ea778)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:25.928983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b3adc-97b3-4e8d-9104-7a97468d48ed None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:25.931858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 41/96] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:25 2022] GET /identity/v3/projects/d780990040124f46b85f1356627ea778 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:25.936957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37c697-5499-4fa2-9ed9-879b4da941d7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:26.085657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37c697-5499-4fa2-9ed9-879b4da941d7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:26.129857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c75b7-2e40-4a92-b9e3-8a44a0e7546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:26.130513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c75b7-2e40-4a92-b9e3-8a44a0e7546c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:26.130796 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c75b7-2e40-4a92-b9e3-8a44a0e7546c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:26.131119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c75b7-2e40-4a92-b9e3-8a44a0e7546c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:26.131862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c75b7-2e40-4a92-b9e3-8a44a0e7546c None admin] RBAC: Adding query filter params (role.id=a9232505007a45c580ef9414aee94847, scope.project.id=d780990040124f46b85f1356627ea778, user.id=7d7ee37393394dd29269a36ed2bfd07c) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:26.132170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c75b7-2e40-4a92-b9e3-8a44a0e7546c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:26.133658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c75b7-2e40-4a92-b9e3-8a44a0e7546c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:26.139862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 56/97] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:25 2022] GET /identity/v3/role_assignments?user.id=7d7ee37393394dd29269a36ed2bfd07c&scope.project.id=d780990040124f46b85f1356627ea778&role.id=a9232505007a45c580ef9414aee94847 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:26.741133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bb6cb-74a4-4db0-96ef-3fec5c3bbefc None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:26.741646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bb6cb-74a4-4db0-96ef-3fec5c3bbefc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:26.741646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bb6cb-74a4-4db0-96ef-3fec5c3bbefc None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:26.743169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 42/98] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:26.748295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656af48-fd56-4012-8cd9-49aadd4bfed2 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:26.748714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656af48-fd56-4012-8cd9-49aadd4bfed2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:26.748897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656af48-fd56-4012-8cd9-49aadd4bfed2 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:26.750197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 57/99] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:26.751608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0151e18-afbd-44cf-af52-3ed1f0ea6509 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:26.752055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0151e18-afbd-44cf-af52-3ed1f0ea6509 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:26.752463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0151e18-afbd-44cf-af52-3ed1f0ea6509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:26.774474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef846d2-5ddf-4729-bf97-dde8d679b571 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:26.774997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef846d2-5ddf-4729-bf97-dde8d679b571 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:26.775405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef846d2-5ddf-4729-bf97-dde8d679b571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:26.780843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f0151e18-afbd-44cf-af52-3ed1f0ea6509 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:26.783613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f0151e18-afbd-44cf-af52-3ed1f0ea6509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:26.803558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-3ef846d2-5ddf-4729-bf97-dde8d679b571 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:26.804942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3ef846d2-5ddf-4729-bf97-dde8d679b571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:26.851994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:26.912909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 43/100] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:26.917268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 58/101] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:27.210203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0151e18-afbd-44cf-af52-3ed1f0ea6509 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:27.335608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0151e18-afbd-44cf-af52-3ed1f0ea6509 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:27.381429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:27.384668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489c12f-d21d-44a9-9fba-b0091b966893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:27.385321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c12f-d21d-44a9-9fba-b0091b966893 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:27.385887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c12f-d21d-44a9-9fba-b0091b966893 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:27.386155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c12f-d21d-44a9-9fba-b0091b966893 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:27.406585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489c12f-d21d-44a9-9fba-b0091b966893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1489c12f-d21d-44a9-9fba-b0091b966893 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:27.411441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:27.412513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:27.414199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 44/102] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:27.418734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef846d2-5ddf-4729-bf97-dde8d679b571 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:27.492324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489c12f-d21d-44a9-9fba-b0091b966893 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:27.579291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef846d2-5ddf-4729-bf97-dde8d679b571 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:27.642103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72165f-1908-4a2a-8420-9925a32ff6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:27.642928 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72165f-1908-4a2a-8420-9925a32ff6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:27.643216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72165f-1908-4a2a-8420-9925a32ff6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:27.643489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72165f-1908-4a2a-8420-9925a32ff6f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:27.644348 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72165f-1908-4a2a-8420-9925a32ff6f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:27.644712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72165f-1908-4a2a-8420-9925a32ff6f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:27.646141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72165f-1908-4a2a-8420-9925a32ff6f5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:27.660530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 59/103] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:27.667457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72165f-1908-4a2a-8420-9925a32ff6f5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:27.669627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489c12f-d21d-44a9-9fba-b0091b966893 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:27.720085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:27.741996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc6a6b-7d88-41f1-a1d5-2669515825ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:27.742732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc6a6b-7d88-41f1-a1d5-2669515825ab None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:27.742918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc6a6b-7d88-41f1-a1d5-2669515825ab None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:27.743176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc6a6b-7d88-41f1-a1d5-2669515825ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:27.744317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc6a6b-7d88-41f1-a1d5-2669515825ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:27.745770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc6a6b-7d88-41f1-a1d5-2669515825ab None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:27.747326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 45/104] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:27.754130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc6a6b-7d88-41f1-a1d5-2669515825ab None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:27.845911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72165f-1908-4a2a-8420-9925a32ff6f5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:27.903474 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:27.914195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1ace7-839f-41f5-ae9c-360afba703f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:27.914846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1ace7-839f-41f5-ae9c-360afba703f9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:27.918998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1ace7-839f-41f5-ae9c-360afba703f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:27.918998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1ace7-839f-41f5-ae9c-360afba703f9 None admin] PATH_INFO: `/v3/users/38c7f7e0e83e42989e86c262725f433f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:27.936391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1ace7-839f-41f5-ae9c-360afba703f9 None admin] RBAC: Authorizing `identity:get_user(user_id=38c7f7e0e83e42989e86c262725f433f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:27.940371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1ace7-839f-41f5-ae9c-360afba703f9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:27.942665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 60/105] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:27 2022] GET /identity/v3/users/38c7f7e0e83e42989e86c262725f433f => generated 289 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:27.948678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1ace7-839f-41f5-ae9c-360afba703f9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:27.993439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc6a6b-7d88-41f1-a1d5-2669515825ab None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:28.064656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccb96d-2e27-43b5-a1db-5e9158100904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:28.065655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccb96d-2e27-43b5-a1db-5e9158100904 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.066134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccb96d-2e27-43b5-a1db-5e9158100904 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.066810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccb96d-2e27-43b5-a1db-5e9158100904 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.069128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccb96d-2e27-43b5-a1db-5e9158100904 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:28.071043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccb96d-2e27-43b5-a1db-5e9158100904 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:28.097174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:28.120238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1ace7-839f-41f5-ae9c-360afba703f9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:28.163579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80220a76-3f86-4f88-a06f-43abc49dd927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:28.164247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80220a76-3f86-4f88-a06f-43abc49dd927 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.164530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80220a76-3f86-4f88-a06f-43abc49dd927 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.164805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80220a76-3f86-4f88-a06f-43abc49dd927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.202779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 46/106] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:43:27 2022] POST /identity/v3/projects => generated 302 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:28.204414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae05038-1a49-423e-b847-8c6332620ca0 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.204945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae05038-1a49-423e-b847-8c6332620ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.205416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae05038-1a49-423e-b847-8c6332620ca0 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.215210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 47/107] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:28.221328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535136-5eec-48b2-ab4e-da373c7a85ab None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.221916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535136-5eec-48b2-ab4e-da373c7a85ab None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.222461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60535136-5eec-48b2-ab4e-da373c7a85ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.239116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80220a76-3f86-4f88-a06f-43abc49dd927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:28.241162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80220a76-3f86-4f88-a06f-43abc49dd927 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:28.267094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-60535136-5eec-48b2-ab4e-da373c7a85ab None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:28.268249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-60535136-5eec-48b2-ab4e-da373c7a85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:28.411219 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:28.446443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 61/108] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:28.453206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80220a76-3f86-4f88-a06f-43abc49dd927 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:28.483202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 48/109] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:28.528190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2e1a-9921-4293-bccc-584e039b7e3e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.528700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2e1a-9921-4293-bccc-584e039b7e3e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.529135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c2e1a-9921-4293-bccc-584e039b7e3e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.530526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 49/110] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:28.546333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01098f-9958-4207-adc5-b9ede85736a8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.546835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01098f-9958-4207-adc5-b9ede85736a8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.547278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01098f-9958-4207-adc5-b9ede85736a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.575752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ff01098f-9958-4207-adc5-b9ede85736a8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:28.578127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ff01098f-9958-4207-adc5-b9ede85736a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:28.639912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:28.643714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80220a76-3f86-4f88-a06f-43abc49dd927 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:28.683227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 50/111] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:28.707568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383f347-3bf0-41ee-a0b2-86ca825ded3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:28.708326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383f347-3bf0-41ee-a0b2-86ca825ded3f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.709147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383f347-3bf0-41ee-a0b2-86ca825ded3f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.709425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383f347-3bf0-41ee-a0b2-86ca825ded3f None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.710711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383f347-3bf0-41ee-a0b2-86ca825ded3f None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:28.712161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383f347-3bf0-41ee-a0b2-86ca825ded3f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:28.714769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 62/112] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:28 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:28.719665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01098f-9958-4207-adc5-b9ede85736a8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:28.837947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01098f-9958-4207-adc5-b9ede85736a8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:28.844528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912b440-6a9f-4f0d-83d5-770c326627e2 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.844818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912b440-6a9f-4f0d-83d5-770c326627e2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.845095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912b440-6a9f-4f0d-83d5-770c326627e2 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.846490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 63/113] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:28.853983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189791c4-07ba-4191-abbe-1f5819662652 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.854533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189791c4-07ba-4191-abbe-1f5819662652 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.855089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189791c4-07ba-4191-abbe-1f5819662652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.893832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-189791c4-07ba-4191-abbe-1f5819662652 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:28.895445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-189791c4-07ba-4191-abbe-1f5819662652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:28.905806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8aa1-cce2-4500-b563-52aa018d302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:28.906430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8aa1-cce2-4500-b563-52aa018d302a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:28.906711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8aa1-cce2-4500-b563-52aa018d302a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:28.906978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8aa1-cce2-4500-b563-52aa018d302a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:28.907712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8aa1-cce2-4500-b563-52aa018d302a None admin] RBAC: Adding query filter params (role.id=1028072c80a14a309ff74e79948a9b25, scope.project.id=b5171171f9c44ffe896d40e40391d4a1, user.id=38c7f7e0e83e42989e86c262725f433f) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:28.908012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8aa1-cce2-4500-b563-52aa018d302a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:28.909459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8aa1-cce2-4500-b563-52aa018d302a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:28.919229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 51/114] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:28 2022] GET /identity/v3/role_assignments?user.id=38c7f7e0e83e42989e86c262725f433f&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=1028072c80a14a309ff74e79948a9b25 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:28.920053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8aa1-cce2-4500-b563-52aa018d302a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:28.983361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:28.997891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:29.021810 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 64/115] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:29.023507 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cdf2a-19d2-4f94-9143-c01abcdbae1e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.023803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cdf2a-19d2-4f94-9143-c01abcdbae1e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.024085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cdf2a-19d2-4f94-9143-c01abcdbae1e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.026061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 65/116] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:29.026763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cdf2a-19d2-4f94-9143-c01abcdbae1e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:29.085197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8aa1-cce2-4500-b563-52aa018d302a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:29.137809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca8153-8c48-4a23-bd67-7e51452e5ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:29.138370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca8153-8c48-4a23-bd67-7e51452e5ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.138890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca8153-8c48-4a23-bd67-7e51452e5ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.139168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca8153-8c48-4a23-bd67-7e51452e5ac3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.154152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca8153-8c48-4a23-bd67-7e51452e5ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:29.158498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cdf2a-19d2-4f94-9143-c01abcdbae1e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-e3ca8153-8c48-4a23-bd67-7e51452e5ac3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:29.160172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:29.161135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:29.162520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:29.164720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 52/117] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:29.164720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e0b0e-0c35-4f13-9352-72c017ab6797 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.164987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e0b0e-0c35-4f13-9352-72c017ab6797 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.165124 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e0b0e-0c35-4f13-9352-72c017ab6797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.196245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7e4e0b0e-0c35-4f13-9352-72c017ab6797 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:29.198866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7e4e0b0e-0c35-4f13-9352-72c017ab6797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:29.231737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca6c32-e72a-4526-9df1-6bd7703e74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:29.232699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca6c32-e72a-4526-9df1-6bd7703e74b8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.232979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca6c32-e72a-4526-9df1-6bd7703e74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.233247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca6c32-e72a-4526-9df1-6bd7703e74b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.247006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca6c32-e72a-4526-9df1-6bd7703e74b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-04ca6c32-e72a-4526-9df1-6bd7703e74b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:29.252077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:29.254442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 66/118] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:43:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:29.257072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca6c32-e72a-4526-9df1-6bd7703e74b8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:29.303681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:29.338488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 53/119] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:29.339382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e0b0e-0c35-4f13-9352-72c017ab6797 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:29.380584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:29.413609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca6c32-e72a-4526-9df1-6bd7703e74b8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:29.470039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e0b0e-0c35-4f13-9352-72c017ab6797 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:29.502196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c300dc4-d68f-40b8-a86f-5730a0ef8071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:29.503097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300dc4-d68f-40b8-a86f-5730a0ef8071 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.503523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300dc4-d68f-40b8-a86f-5730a0ef8071 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.503938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300dc4-d68f-40b8-a86f-5730a0ef8071 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.504755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c300dc4-d68f-40b8-a86f-5730a0ef8071 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:29.505263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c300dc4-d68f-40b8-a86f-5730a0ef8071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:29.506784 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c300dc4-d68f-40b8-a86f-5730a0ef8071 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:29.510812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be1cf9-c5c3-44a7-bb85-cbbba07fe16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:29.511720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be1cf9-c5c3-44a7-bb85-cbbba07fe16a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.512189 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be1cf9-c5c3-44a7-bb85-cbbba07fe16a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.512662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be1cf9-c5c3-44a7-bb85-cbbba07fe16a None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.513532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be1cf9-c5c3-44a7-bb85-cbbba07fe16a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:29.514063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be1cf9-c5c3-44a7-bb85-cbbba07fe16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:29.516155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be1cf9-c5c3-44a7-bb85-cbbba07fe16a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:29.526809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 54/120] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:43:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:29.528084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be1cf9-c5c3-44a7-bb85-cbbba07fe16a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:29.529049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 67/121] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:29.534382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c300dc4-d68f-40b8-a86f-5730a0ef8071 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:29.670950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:29.692381 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be1cf9-c5c3-44a7-bb85-cbbba07fe16a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:29.699245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c300dc4-d68f-40b8-a86f-5730a0ef8071 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:29.701894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:29.734682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd326c-6bbc-4d31-83c7-23106460b8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:29.735711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd326c-6bbc-4d31-83c7-23106460b8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.736198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd326c-6bbc-4d31-83c7-23106460b8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.736677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd326c-6bbc-4d31-83c7-23106460b8b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.738735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd614-c100-448e-906c-52316fb24843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:29.739369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd614-c100-448e-906c-52316fb24843 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.740216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd614-c100-448e-906c-52316fb24843 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.740466 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd614-c100-448e-906c-52316fb24843 None admin] PATH_INFO: `/v3/users/7d7ee37393394dd29269a36ed2bfd07c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.741625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bd614-c100-448e-906c-52316fb24843 None admin] RBAC: Authorizing `identity:get_user(user_id=7d7ee37393394dd29269a36ed2bfd07c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:29.743072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bd614-c100-448e-906c-52316fb24843 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:29.749076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 68/122] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:29 2022] GET /identity/v3/users/7d7ee37393394dd29269a36ed2bfd07c => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:29.749076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd614-c100-448e-906c-52316fb24843 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:29.754340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd326c-6bbc-4d31-83c7-23106460b8b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-21fd326c-6bbc-4d31-83c7-23106460b8b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:29.760192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:29.761053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:29.761865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:29.764192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 55/123] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:29.765295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd326c-6bbc-4d31-83c7-23106460b8b2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:29.847699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd614-c100-448e-906c-52316fb24843 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:29.873100 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd326c-6bbc-4d31-83c7-23106460b8b2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:29.883612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a709d-5857-444e-9c8d-cd839224ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:29.884232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a709d-5857-444e-9c8d-cd839224ba3f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.884666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a709d-5857-444e-9c8d-cd839224ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.885071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a709d-5857-444e-9c8d-cd839224ba3f None admin] PATH_INFO: `/v3/users/7d7ee37393394dd29269a36ed2bfd07c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.886377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a709d-5857-444e-9c8d-cd839224ba3f None admin] RBAC: Authorizing `identity:get_user(user_id=7d7ee37393394dd29269a36ed2bfd07c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:29.887958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a709d-5857-444e-9c8d-cd839224ba3f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:29.889752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 69/124] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:29 2022] GET /identity/v3/users/7d7ee37393394dd29269a36ed2bfd07c => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:29.890749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a709d-5857-444e-9c8d-cd839224ba3f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:29.910942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526ee6-aab8-4696-b126-43f3f2241cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:29.912432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526ee6-aab8-4696-b126-43f3f2241cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:29.912957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526ee6-aab8-4696-b126-43f3f2241cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:29.913726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526ee6-aab8-4696-b126-43f3f2241cf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:29.925216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526ee6-aab8-4696-b126-43f3f2241cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-70526ee6-aab8-4696-b126-43f3f2241cf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:29.931668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:29.932558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:29.933368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:29.935488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:29.936861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 56/125] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:29.937896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526ee6-aab8-4696-b126-43f3f2241cf6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:29.953985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:30.001571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a709d-5857-444e-9c8d-cd839224ba3f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.050950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc212f49-0290-4504-9005-6e1d4c8cad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.053835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc212f49-0290-4504-9005-6e1d4c8cad18 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.054528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc212f49-0290-4504-9005-6e1d4c8cad18 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.055241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc212f49-0290-4504-9005-6e1d4c8cad18 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.055401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526ee6-aab8-4696-b126-43f3f2241cf6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.058951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc212f49-0290-4504-9005-6e1d4c8cad18 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.061956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc212f49-0290-4504-9005-6e1d4c8cad18 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.067201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 70/126] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:29 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:30.069303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc212f49-0290-4504-9005-6e1d4c8cad18 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:30.100374 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9906-d372-4458-b45c-f32b12af648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.101278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9906-d372-4458-b45c-f32b12af648f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.101778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9906-d372-4458-b45c-f32b12af648f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.102224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9906-d372-4458-b45c-f32b12af648f None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.103098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c9906-d372-4458-b45c-f32b12af648f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:30.103573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c9906-d372-4458-b45c-f32b12af648f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.105129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c9906-d372-4458-b45c-f32b12af648f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.117026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 57/127] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:30.118104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9906-d372-4458-b45c-f32b12af648f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:30.199209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:30.235680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc212f49-0290-4504-9005-6e1d4c8cad18 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.236457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9906-d372-4458-b45c-f32b12af648f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.245255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:30.273827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b6384-57bb-4ba3-8b67-d25a55fa9da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.274741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6384-57bb-4ba3-8b67-d25a55fa9da7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.275294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6384-57bb-4ba3-8b67-d25a55fa9da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.275762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6384-57bb-4ba3-8b67-d25a55fa9da7 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.276644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b6384-57bb-4ba3-8b67-d25a55fa9da7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:30.277141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b6384-57bb-4ba3-8b67-d25a55fa9da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.278744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b6384-57bb-4ba3-8b67-d25a55fa9da7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.279397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89732-af9f-4b71-9cb4-a09ca1afb90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.280028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89732-af9f-4b71-9cb4-a09ca1afb90a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.280307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89732-af9f-4b71-9cb4-a09ca1afb90a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.280578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89732-af9f-4b71-9cb4-a09ca1afb90a None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.282442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb89732-af9f-4b71-9cb4-a09ca1afb90a None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.283990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb89732-af9f-4b71-9cb4-a09ca1afb90a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.287818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 71/128] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:30 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:30.289061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89732-af9f-4b71-9cb4-a09ca1afb90a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:30.294502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 58/129] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:30.295322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b6384-57bb-4ba3-8b67-d25a55fa9da7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:30.410660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89732-af9f-4b71-9cb4-a09ca1afb90a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.447425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b6384-57bb-4ba3-8b67-d25a55fa9da7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.453485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e964c6-34b4-4aac-831a-08289f92fd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.454392 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e964c6-34b4-4aac-831a-08289f92fd39 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.455390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e964c6-34b4-4aac-831a-08289f92fd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.455856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e964c6-34b4-4aac-831a-08289f92fd39 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1/users/7d7ee37393394dd29269a36ed2bfd07c/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.459278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e964c6-34b4-4aac-831a-08289f92fd39 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5171171f9c44ffe896d40e40391d4a1, user_id=7d7ee37393394dd29269a36ed2bfd07c, role_id=6a99e3ee2e8546c8a6cc6f4e33997bfd)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.461271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e964c6-34b4-4aac-831a-08289f92fd39 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.475247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:30.483138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421b73-548d-4bcd-97f6-76abdac942ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.483896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421b73-548d-4bcd-97f6-76abdac942ea None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.484245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421b73-548d-4bcd-97f6-76abdac942ea None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.484587 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9421b73-548d-4bcd-97f6-76abdac942ea None admin] PATH_INFO: `/v3/users/57c499431d554526bf65401b415ad207` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.485806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9421b73-548d-4bcd-97f6-76abdac942ea None admin] RBAC: Authorizing `identity:get_user(user_id=57c499431d554526bf65401b415ad207)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.487340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9421b73-548d-4bcd-97f6-76abdac942ea None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.493598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 59/130] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:30 2022] GET /identity/v3/users/57c499431d554526bf65401b415ad207 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:30.493598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421b73-548d-4bcd-97f6-76abdac942ea None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:30.539946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 72/131] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:43:30 2022] PUT /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1/users/7d7ee37393394dd29269a36ed2bfd07c/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:30.540920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e964c6-34b4-4aac-831a-08289f92fd39 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:30.591925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:30.615928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9421b73-548d-4bcd-97f6-76abdac942ea None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.663910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43cce-ce38-4191-adee-95656bf4e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.665018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43cce-ce38-4191-adee-95656bf4e95d None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.665535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43cce-ce38-4191-adee-95656bf4e95d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.666170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43cce-ce38-4191-adee-95656bf4e95d None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1/users/7d7ee37393394dd29269a36ed2bfd07c/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.668436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f43cce-ce38-4191-adee-95656bf4e95d None admin] RBAC: Authorizing `identity:create_grant(project_id=b5171171f9c44ffe896d40e40391d4a1, user_id=7d7ee37393394dd29269a36ed2bfd07c, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.670408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f43cce-ce38-4191-adee-95656bf4e95d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.702846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e964c6-34b4-4aac-831a-08289f92fd39 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.743600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c36f9-33ee-4358-8149-768cecfac5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.744661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c36f9-33ee-4358-8149-768cecfac5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.745154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c36f9-33ee-4358-8149-768cecfac5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.745722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c36f9-33ee-4358-8149-768cecfac5d3 None admin] PATH_INFO: `/v3/users/7d7ee37393394dd29269a36ed2bfd07c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.747282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c36f9-33ee-4358-8149-768cecfac5d3 None admin] RBAC: Authorizing `identity:get_user(user_id=7d7ee37393394dd29269a36ed2bfd07c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.749081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c36f9-33ee-4358-8149-768cecfac5d3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.751037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 73/132] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:30 2022] GET /identity/v3/users/7d7ee37393394dd29269a36ed2bfd07c => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:30.752038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c36f9-33ee-4358-8149-768cecfac5d3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:30.783291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 60/133] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:43:30 2022] PUT /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1/users/7d7ee37393394dd29269a36ed2bfd07c/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:30.784151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43cce-ce38-4191-adee-95656bf4e95d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:30.857045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:30.876519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c36f9-33ee-4358-8149-768cecfac5d3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.878314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:30.907460 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43cce-ce38-4191-adee-95656bf4e95d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:30.914790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813d3ff-f96c-4d8e-ab4c-209f1d983c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.915452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813d3ff-f96c-4d8e-ab4c-209f1d983c44 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.915730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813d3ff-f96c-4d8e-ab4c-209f1d983c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.916001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813d3ff-f96c-4d8e-ab4c-209f1d983c44 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.917290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813d3ff-f96c-4d8e-ab4c-209f1d983c44 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.918970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813d3ff-f96c-4d8e-ab4c-209f1d983c44 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.920544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 74/134] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:30 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:30.926568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813d3ff-f96c-4d8e-ab4c-209f1d983c44 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:30.950305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96568e96-4e37-414d-bae0-c76b539f7c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:30.951307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96568e96-4e37-414d-bae0-c76b539f7c6c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:30.951881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96568e96-4e37-414d-bae0-c76b539f7c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:30.952354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96568e96-4e37-414d-bae0-c76b539f7c6c None admin] PATH_INFO: `/v3/projects/d780990040124f46b85f1356627ea778` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:30.953884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96568e96-4e37-414d-bae0-c76b539f7c6c None admin] RBAC: Authorizing `identity:get_project(project_id=d780990040124f46b85f1356627ea778)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:30.955674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96568e96-4e37-414d-bae0-c76b539f7c6c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:30.957890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 61/135] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:30 2022] GET /identity/v3/projects/d780990040124f46b85f1356627ea778 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:30.966684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96568e96-4e37-414d-bae0-c76b539f7c6c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:31.041553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813d3ff-f96c-4d8e-ab4c-209f1d983c44 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:31.080799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96568e96-4e37-414d-bae0-c76b539f7c6c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:31.110208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f23ed-0dcb-48f1-ac73-e16980c13a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:31.110888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f23ed-0dcb-48f1-ac73-e16980c13a10 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:31.111162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f23ed-0dcb-48f1-ac73-e16980c13a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:31.111521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f23ed-0dcb-48f1-ac73-e16980c13a10 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1/users/57c499431d554526bf65401b415ad207/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:31.114422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f23ed-0dcb-48f1-ac73-e16980c13a10 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5171171f9c44ffe896d40e40391d4a1, user_id=57c499431d554526bf65401b415ad207, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:31.115660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:31.115897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f23ed-0dcb-48f1-ac73-e16980c13a10 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:31.130082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798975cc-9767-4d9b-9c91-fb1326afb26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:31.131130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798975cc-9767-4d9b-9c91-fb1326afb26b None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:31.131410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798975cc-9767-4d9b-9c91-fb1326afb26b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:31.131681 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798975cc-9767-4d9b-9c91-fb1326afb26b None admin] PATH_INFO: `/v3/projects/d780990040124f46b85f1356627ea778/users/7d7ee37393394dd29269a36ed2bfd07c/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:31.133668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798975cc-9767-4d9b-9c91-fb1326afb26b None admin] RBAC: Authorizing `identity:create_grant(project_id=d780990040124f46b85f1356627ea778, user_id=7d7ee37393394dd29269a36ed2bfd07c, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:31.135183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798975cc-9767-4d9b-9c91-fb1326afb26b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:31.201011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 75/136] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:43:30 2022] PUT /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1/users/57c499431d554526bf65401b415ad207/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:31.202650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c522-ec20-43d9-869c-2587c4524f7b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:31.202939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c522-ec20-43d9-869c-2587c4524f7b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:31.203216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745c522-ec20-43d9-869c-2587c4524f7b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:31.204461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 76/137] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:31.205551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452bb0e-72f1-4116-8a21-e6cfa0167ab9 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:31.205968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452bb0e-72f1-4116-8a21-e6cfa0167ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:31.206380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452bb0e-72f1-4116-8a21-e6cfa0167ab9 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:31.207559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 77/138] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:31.212690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72817427-cefb-49e1-95fb-b8ef5cc451de None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:31.212967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72817427-cefb-49e1-95fb-b8ef5cc451de None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:31.213242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72817427-cefb-49e1-95fb-b8ef5cc451de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:31.233637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 62/139] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:43:30 2022] PUT /identity/v3/projects/d780990040124f46b85f1356627ea778/users/7d7ee37393394dd29269a36ed2bfd07c/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:31.234884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a593-8276-44bc-a906-5dee6beb6ad3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:31.235171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a593-8276-44bc-a906-5dee6beb6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:31.235444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a593-8276-44bc-a906-5dee6beb6ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:31.236879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-72817427-cefb-49e1-95fb-b8ef5cc451de None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:31.237331 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-72817427-cefb-49e1-95fb-b8ef5cc451de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:31.282627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ed64a593-8276-44bc-a906-5dee6beb6ad3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:31.283862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ed64a593-8276-44bc-a906-5dee6beb6ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:31.290747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:31.394600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 78/140] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:31.459785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 63/141] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:31.705990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72817427-cefb-49e1-95fb-b8ef5cc451de None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:31.837591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72817427-cefb-49e1-95fb-b8ef5cc451de None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:31.883203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c825c68-b677-473c-8a91-d3e3f6594a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:31.883845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c825c68-b677-473c-8a91-d3e3f6594a9f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:31.884122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c825c68-b677-473c-8a91-d3e3f6594a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:31.884392 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c825c68-b677-473c-8a91-d3e3f6594a9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:31.885555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c825c68-b677-473c-8a91-d3e3f6594a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:31.887012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c825c68-b677-473c-8a91-d3e3f6594a9f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:31.888769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 79/142] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:31.894540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64a593-8276-44bc-a906-5dee6beb6ad3 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:31.995665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c825c68-b677-473c-8a91-d3e3f6594a9f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:32.059693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:32.060367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64a593-8276-44bc-a906-5dee6beb6ad3 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:32.090592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:32.131849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccd20-47f9-48e9-aadc-a89342c74861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:32.132475 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccd20-47f9-48e9-aadc-a89342c74861 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:32.132758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccd20-47f9-48e9-aadc-a89342c74861 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:32.133031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeccd20-47f9-48e9-aadc-a89342c74861 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:32.133708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeccd20-47f9-48e9-aadc-a89342c74861 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:32.135192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeccd20-47f9-48e9-aadc-a89342c74861 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:32.214351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c825c68-b677-473c-8a91-d3e3f6594a9f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:32.255583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 64/143] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:43:31 2022] POST /identity/v3/users => generated 283 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:32.280095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a29dc-66d5-42e5-adea-e4af5a6f954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:32.280760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a29dc-66d5-42e5-adea-e4af5a6f954b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:32.281052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a29dc-66d5-42e5-adea-e4af5a6f954b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:32.281301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a29dc-66d5-42e5-adea-e4af5a6f954b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:32.296641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a29dc-66d5-42e5-adea-e4af5a6f954b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-124a29dc-66d5-42e5-adea-e4af5a6f954b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:32.302985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:32.304158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:32.304919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:32.307532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 80/144] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:32.313266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccd20-47f9-48e9-aadc-a89342c74861 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:32.470530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeccd20-47f9-48e9-aadc-a89342c74861 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:32.513448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c973c33-2e8a-47f5-8501-a45e03bacb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:32.514013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c973c33-2e8a-47f5-8501-a45e03bacb27 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:32.514294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c973c33-2e8a-47f5-8501-a45e03bacb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:32.514569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c973c33-2e8a-47f5-8501-a45e03bacb27 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:32.515244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c973c33-2e8a-47f5-8501-a45e03bacb27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:32.515545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c973c33-2e8a-47f5-8501-a45e03bacb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:32.516932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c973c33-2e8a-47f5-8501-a45e03bacb27 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:32.531835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a29dc-66d5-42e5-adea-e4af5a6f954b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:32.533825 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 65/145] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:32.762236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:32.791781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a29dc-66d5-42e5-adea-e4af5a6f954b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:32.854745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c83e0-9a2b-4a1e-a5ae-48e1cdecc10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:32.855396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c83e0-9a2b-4a1e-a5ae-48e1cdecc10b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:32.855676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c83e0-9a2b-4a1e-a5ae-48e1cdecc10b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:32.855947 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c83e0-9a2b-4a1e-a5ae-48e1cdecc10b None admin] PATH_INFO: `/v3/users/38c7f7e0e83e42989e86c262725f433f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:32.857131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c83e0-9a2b-4a1e-a5ae-48e1cdecc10b None admin] RBAC: Authorizing `identity:get_user(user_id=38c7f7e0e83e42989e86c262725f433f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:32.858715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c83e0-9a2b-4a1e-a5ae-48e1cdecc10b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:32.860545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 81/146] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:32 2022] GET /identity/v3/users/38c7f7e0e83e42989e86c262725f433f => generated 289 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:32.870590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c973c33-2e8a-47f5-8501-a45e03bacb27 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:32.937935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:33.079820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c973c33-2e8a-47f5-8501-a45e03bacb27 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:33.126905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb644d2-73f4-4764-926c-64f77dd2ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:33.127547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb644d2-73f4-4764-926c-64f77dd2ed33 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:33.127827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb644d2-73f4-4764-926c-64f77dd2ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:33.128098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb644d2-73f4-4764-926c-64f77dd2ed33 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:33.129254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb644d2-73f4-4764-926c-64f77dd2ed33 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:33.130783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb644d2-73f4-4764-926c-64f77dd2ed33 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:33.132653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 66/147] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:32 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:33.138539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c83e0-9a2b-4a1e-a5ae-48e1cdecc10b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:33.313044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c83e0-9a2b-4a1e-a5ae-48e1cdecc10b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:33.331387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0defc6-9a79-4be1-b331-97d4d7d59ec3 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:33.331680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0defc6-9a79-4be1-b331-97d4d7d59ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:33.331875 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0defc6-9a79-4be1-b331-97d4d7d59ec3 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:33.333580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 67/148] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:33.339672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e577fe5-ae5d-4adb-9892-0a00d57775ce None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:33.340006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e577fe5-ae5d-4adb-9892-0a00d57775ce None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:33.340293 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e577fe5-ae5d-4adb-9892-0a00d57775ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:33.360176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d1d2b-9e3d-4b44-a4c1-b57a09789f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:33.360844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d1d2b-9e3d-4b44-a4c1-b57a09789f90 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:33.361117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d1d2b-9e3d-4b44-a4c1-b57a09789f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:33.361382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d1d2b-9e3d-4b44-a4c1-b57a09789f90 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1/users/38c7f7e0e83e42989e86c262725f433f/roles/1028072c80a14a309ff74e79948a9b25` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:33.365767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d1d2b-9e3d-4b44-a4c1-b57a09789f90 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5171171f9c44ffe896d40e40391d4a1, user_id=38c7f7e0e83e42989e86c262725f433f, role_id=1028072c80a14a309ff74e79948a9b25)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:33.367212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d1d2b-9e3d-4b44-a4c1-b57a09789f90 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:33.378508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-8e577fe5-ae5d-4adb-9892-0a00d57775ce None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:33.379726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8e577fe5-ae5d-4adb-9892-0a00d57775ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:33.470638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 68/149] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:33.528723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 82/150] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:43:33 2022] PUT /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1/users/38c7f7e0e83e42989e86c262725f433f/roles/1028072c80a14a309ff74e79948a9b25 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:33.611287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b529d77-34dd-406c-9ca8-84e436dacaad None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:33.611565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b529d77-34dd-406c-9ca8-84e436dacaad None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:33.611761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b529d77-34dd-406c-9ca8-84e436dacaad None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:33.613147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 69/151] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:33.619234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11013-fb9d-4eb1-a446-5d196caa06e4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:33.619510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11013-fb9d-4eb1-a446-5d196caa06e4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:33.619784 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e11013-fb9d-4eb1-a446-5d196caa06e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:33.643944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-99e11013-fb9d-4eb1-a446-5d196caa06e4 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:33.645135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-99e11013-fb9d-4eb1-a446-5d196caa06e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:33.659615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:33.732354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 83/152] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:34.031345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b529d77-34dd-406c-9ca8-84e436dacaad None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:34.066092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:34.122070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503200-1202-4662-8231-04ebdfaa1779 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:34.122414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503200-1202-4662-8231-04ebdfaa1779 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:34.122598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503200-1202-4662-8231-04ebdfaa1779 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:34.124187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 84/153] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:34.130443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24da29c-f697-49b5-a2d9-4d387d8a7b01 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:34.130720 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24da29c-f697-49b5-a2d9-4d387d8a7b01 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:34.130991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24da29c-f697-49b5-a2d9-4d387d8a7b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:34.162509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b529d77-34dd-406c-9ca8-84e436dacaad None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:34.174482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a24da29c-f697-49b5-a2d9-4d387d8a7b01 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:34.175679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a24da29c-f697-49b5-a2d9-4d387d8a7b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:34.207170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44a5ae-63d5-4a3d-bb00-2c4da1afd591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:34.207822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44a5ae-63d5-4a3d-bb00-2c4da1afd591 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:34.208761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44a5ae-63d5-4a3d-bb00-2c4da1afd591 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:34.209107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44a5ae-63d5-4a3d-bb00-2c4da1afd591 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:34.227392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44a5ae-63d5-4a3d-bb00-2c4da1afd591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-dd44a5ae-63d5-4a3d-bb00-2c4da1afd591 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:34.232212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:34.233057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:34.233844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 70/154] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:43:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:34.235655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8a24-cfb2-4b85-a96f-c571d166561d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:34.235655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8a24-cfb2-4b85-a96f-c571d166561d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:34.235655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e8a24-cfb2-4b85-a96f-c571d166561d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:34.236515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 71/155] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:34.242664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8a24-cfb2-4b85-a96f-c571d166561d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:34.316753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 85/156] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:34.318390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339bb7d-ef72-425c-9620-d1dbc21300a9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:34.318869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339bb7d-ef72-425c-9620-d1dbc21300a9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:34.319141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339bb7d-ef72-425c-9620-d1dbc21300a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:34.356973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d339bb7d-ef72-425c-9620-d1dbc21300a9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:34.358248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d339bb7d-ef72-425c-9620-d1dbc21300a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:34.403835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:34.423663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e8a24-cfb2-4b85-a96f-c571d166561d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:34.487756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e92c3-a141-411a-bf35-12bdfff4eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:34.488738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e92c3-a141-411a-bf35-12bdfff4eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:34.489268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e92c3-a141-411a-bf35-12bdfff4eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:34.490485 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e92c3-a141-411a-bf35-12bdfff4eaf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:34.491402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e92c3-a141-411a-bf35-12bdfff4eaf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:34.491889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e92c3-a141-411a-bf35-12bdfff4eaf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:34.493486 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e92c3-a141-411a-bf35-12bdfff4eaf5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:34.502985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 86/157] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:34.505696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339bb7d-ef72-425c-9620-d1dbc21300a9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:34.506681 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 72/158] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:43:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:34.514933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e92c3-a141-411a-bf35-12bdfff4eaf5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:34.524188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:34.675929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e92c3-a141-411a-bf35-12bdfff4eaf5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:34.717417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a080a-0fbb-48cb-897a-3db29e1f5490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:34.718661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a080a-0fbb-48cb-897a-3db29e1f5490 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:34.719146 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a080a-0fbb-48cb-897a-3db29e1f5490 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:34.719621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a080a-0fbb-48cb-897a-3db29e1f5490 None admin] PATH_INFO: `/v3/users/7d7ee37393394dd29269a36ed2bfd07c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:34.719721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339bb7d-ef72-425c-9620-d1dbc21300a9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:34.721052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a080a-0fbb-48cb-897a-3db29e1f5490 None admin] RBAC: Authorizing `identity:get_user(user_id=7d7ee37393394dd29269a36ed2bfd07c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:34.722877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a080a-0fbb-48cb-897a-3db29e1f5490 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:34.724840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 73/159] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:34 2022] GET /identity/v3/users/7d7ee37393394dd29269a36ed2bfd07c => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:34.730576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a080a-0fbb-48cb-897a-3db29e1f5490 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:34.767645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:34.834188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c9287-6fc1-4a89-8f4c-4228b8015e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:34.834846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c9287-6fc1-4a89-8f4c-4228b8015e88 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:34.835121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c9287-6fc1-4a89-8f4c-4228b8015e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:34.835401 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c9287-6fc1-4a89-8f4c-4228b8015e88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:34.866425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c9287-6fc1-4a89-8f4c-4228b8015e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-210c9287-6fc1-4a89-8f4c-4228b8015e88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:34.871190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:34.872074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:34.872846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 87/160] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:34.879579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c9287-6fc1-4a89-8f4c-4228b8015e88 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:34.910881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a080a-0fbb-48cb-897a-3db29e1f5490 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:34.973216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4706-2991-4cf6-9d22-33d382cb782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:34.974317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4706-2991-4cf6-9d22-33d382cb782c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:34.974788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4706-2991-4cf6-9d22-33d382cb782c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:34.975246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4706-2991-4cf6-9d22-33d382cb782c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:35.016284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:35.093145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c9287-6fc1-4a89-8f4c-4228b8015e88 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:35.094894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e4706-2991-4cf6-9d22-33d382cb782c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:35.096594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e4706-2991-4cf6-9d22-33d382cb782c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:35.135453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:35.168652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae3a42-1abc-433b-9dd4-547fba417b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:35.169713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae3a42-1abc-433b-9dd4-547fba417b31 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:35.170221 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae3a42-1abc-433b-9dd4-547fba417b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:35.172170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae3a42-1abc-433b-9dd4-547fba417b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:35.173033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae3a42-1abc-433b-9dd4-547fba417b31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:35.173740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae3a42-1abc-433b-9dd4-547fba417b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:35.178111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae3a42-1abc-433b-9dd4-547fba417b31 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:35.196751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 88/161] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:35.198146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae3a42-1abc-433b-9dd4-547fba417b31 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:35.295908 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 74/162] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:35.298298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4706-2991-4cf6-9d22-33d382cb782c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:35.393253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae3a42-1abc-433b-9dd4-547fba417b31 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:35.422607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:35.431988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7d80c-b42c-453e-ad81-1b9b5769b69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:35.432620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7d80c-b42c-453e-ad81-1b9b5769b69b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:35.432893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7d80c-b42c-453e-ad81-1b9b5769b69b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:35.433213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7d80c-b42c-453e-ad81-1b9b5769b69b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:35.446603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7d80c-b42c-453e-ad81-1b9b5769b69b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-98d7d80c-b42c-453e-ad81-1b9b5769b69b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:35.451886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:35.452742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:35.453558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 89/163] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:35.457488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7d80c-b42c-453e-ad81-1b9b5769b69b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:35.531246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4706-2991-4cf6-9d22-33d382cb782c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:35.553282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:35.588619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7d80c-b42c-453e-ad81-1b9b5769b69b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:35.594212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e27f34-6256-4463-8a87-c575ae2ea5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:35.594877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e27f34-6256-4463-8a87-c575ae2ea5db None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:35.595154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e27f34-6256-4463-8a87-c575ae2ea5db None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:35.595430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e27f34-6256-4463-8a87-c575ae2ea5db None admin] PATH_INFO: `/v3/users/7d7ee37393394dd29269a36ed2bfd07c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:35.596678 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e27f34-6256-4463-8a87-c575ae2ea5db None admin] RBAC: Authorizing `identity:get_user(user_id=7d7ee37393394dd29269a36ed2bfd07c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:35.598182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e27f34-6256-4463-8a87-c575ae2ea5db None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:35.599910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 75/164] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:35 2022] GET /identity/v3/users/7d7ee37393394dd29269a36ed2bfd07c => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:35.600718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e27f34-6256-4463-8a87-c575ae2ea5db None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:35.639183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd6c7c-b281-43bd-ba44-6db0d7b0417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:35.640195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd6c7c-b281-43bd-ba44-6db0d7b0417a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:35.640978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd6c7c-b281-43bd-ba44-6db0d7b0417a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:35.641446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd6c7c-b281-43bd-ba44-6db0d7b0417a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:35.658746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd6c7c-b281-43bd-ba44-6db0d7b0417a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-8dbd6c7c-b281-43bd-ba44-6db0d7b0417a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:35.665114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:35.666278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:35.667051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:35.669771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 90/165] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:35.671268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd6c7c-b281-43bd-ba44-6db0d7b0417a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:35.755750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:35.790143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e27f34-6256-4463-8a87-c575ae2ea5db None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:35.830337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770e476-d572-443e-ae01-a50b558884c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:35.831380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770e476-d572-443e-ae01-a50b558884c0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:35.831919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770e476-d572-443e-ae01-a50b558884c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:35.832521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770e476-d572-443e-ae01-a50b558884c0 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:35.834365 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770e476-d572-443e-ae01-a50b558884c0 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:35.836235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770e476-d572-443e-ae01-a50b558884c0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:35.838188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 76/166] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:35 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:35.839286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770e476-d572-443e-ae01-a50b558884c0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:35.875898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd6c7c-b281-43bd-ba44-6db0d7b0417a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:35.904797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:35.956979 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770e476-d572-443e-ae01-a50b558884c0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:35.970212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852d44b-e327-4347-aec9-697a81b5b5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:35.970883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852d44b-e327-4347-aec9-697a81b5b5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:35.971125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852d44b-e327-4347-aec9-697a81b5b5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:35.971396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852d44b-e327-4347-aec9-697a81b5b5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:35.972077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852d44b-e327-4347-aec9-697a81b5b5f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:35.972379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852d44b-e327-4347-aec9-697a81b5b5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:35.974406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852d44b-e327-4347-aec9-697a81b5b5f9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:35.989029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 91/167] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:35.990597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852d44b-e327-4347-aec9-697a81b5b5f9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:35.998850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea94a7-9ce5-4ce7-9b67-e2477053d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:35.999824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea94a7-9ce5-4ce7-9b67-e2477053d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:36.000291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea94a7-9ce5-4ce7-9b67-e2477053d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:36.000814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea94a7-9ce5-4ce7-9b67-e2477053d3e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:36.079181 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea94a7-9ce5-4ce7-9b67-e2477053d3e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:36.081264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea94a7-9ce5-4ce7-9b67-e2477053d3e6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:36.144488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:36.208242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 77/168] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:36.209356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea94a7-9ce5-4ce7-9b67-e2477053d3e6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:36.237880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852d44b-e327-4347-aec9-697a81b5b5f9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:36.257041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:36.311499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892e42-ca2d-40b8-b47e-728e01865cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:36.312264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892e42-ca2d-40b8-b47e-728e01865cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:36.312369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892e42-ca2d-40b8-b47e-728e01865cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:36.312654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1892e42-ca2d-40b8-b47e-728e01865cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:36.313313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892e42-ca2d-40b8-b47e-728e01865cb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:36.313632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892e42-ca2d-40b8-b47e-728e01865cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:36.318797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1892e42-ca2d-40b8-b47e-728e01865cb8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:36.327787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 92/169] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:36.328503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892e42-ca2d-40b8-b47e-728e01865cb8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:36.442131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea94a7-9ce5-4ce7-9b67-e2477053d3e6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:36.506990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2ca4-561a-4343-94f6-4f9c4c10c273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:36.507629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2ca4-561a-4343-94f6-4f9c4c10c273 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:36.509084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2ca4-561a-4343-94f6-4f9c4c10c273 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:36.509084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2ca4-561a-4343-94f6-4f9c4c10c273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:36.509084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2ca4-561a-4343-94f6-4f9c4c10c273 None admin] RBAC: Adding query filter params (role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=b5171171f9c44ffe896d40e40391d4a1, user.id=7d7ee37393394dd29269a36ed2bfd07c) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:36.509447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2ca4-561a-4343-94f6-4f9c4c10c273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:36.512582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2ca4-561a-4343-94f6-4f9c4c10c273 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:36.521019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 78/170] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:36 2022] GET /identity/v3/role_assignments?user.id=7d7ee37393394dd29269a36ed2bfd07c&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:36.521869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2ca4-561a-4343-94f6-4f9c4c10c273 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:36.536778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1892e42-ca2d-40b8-b47e-728e01865cb8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:36.569406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:36.608739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40b920-cbec-4ef6-b308-b1721f4a28c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:36.609763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40b920-cbec-4ef6-b308-b1721f4a28c0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:36.610241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40b920-cbec-4ef6-b308-b1721f4a28c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:36.610852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40b920-cbec-4ef6-b308-b1721f4a28c0 None admin] PATH_INFO: `/v3/users/57c499431d554526bf65401b415ad207` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:36.612404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40b920-cbec-4ef6-b308-b1721f4a28c0 None admin] RBAC: Authorizing `identity:get_user(user_id=57c499431d554526bf65401b415ad207)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:36.614551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40b920-cbec-4ef6-b308-b1721f4a28c0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:36.621362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 93/171] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:36 2022] GET /identity/v3/users/57c499431d554526bf65401b415ad207 => generated 247 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:36.622624 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40b920-cbec-4ef6-b308-b1721f4a28c0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:36.700483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:36.751756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2ca4-561a-4343-94f6-4f9c4c10c273 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:36.785884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40b920-cbec-4ef6-b308-b1721f4a28c0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:36.825421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a304-cb0b-40a2-9171-b64e6e02294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:36.826090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a304-cb0b-40a2-9171-b64e6e02294d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:36.826370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a304-cb0b-40a2-9171-b64e6e02294d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:36.826642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a304-cb0b-40a2-9171-b64e6e02294d None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:36.828204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92a304-cb0b-40a2-9171-b64e6e02294d None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:36.829936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92a304-cb0b-40a2-9171-b64e6e02294d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:36.831415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 79/172] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:36 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:36.832178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a304-cb0b-40a2-9171-b64e6e02294d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:36.832484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b02b38-dc1f-4e62-bb33-507e6b2282fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:36.833942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02b38-dc1f-4e62-bb33-507e6b2282fc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:36.834286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02b38-dc1f-4e62-bb33-507e6b2282fc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:36.834558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02b38-dc1f-4e62-bb33-507e6b2282fc None admin] PATH_INFO: `/v3/users/7d7ee37393394dd29269a36ed2bfd07c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:36.835721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b02b38-dc1f-4e62-bb33-507e6b2282fc None admin] RBAC: Authorizing `identity:get_user(user_id=7d7ee37393394dd29269a36ed2bfd07c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:36.837166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b02b38-dc1f-4e62-bb33-507e6b2282fc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:36.838875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 94/173] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:36 2022] GET /identity/v3/users/7d7ee37393394dd29269a36ed2bfd07c => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:36.840069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742e40e-c68a-4bb0-a964-b61cf833d210 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:36.840345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742e40e-c68a-4bb0-a964-b61cf833d210 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:36.840860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742e40e-c68a-4bb0-a964-b61cf833d210 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:36.843224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 95/174] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:36.844113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ddb7-9d61-415a-a069-4da87ed7b31c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:36.844382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ddb7-9d61-415a-a069-4da87ed7b31c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:36.844646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ddb7-9d61-415a-a069-4da87ed7b31c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:36.846046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 96/175] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:36.846914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1bfc-bb33-4d6e-b938-a85c1a9a38f2 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:36.847190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1bfc-bb33-4d6e-b938-a85c1a9a38f2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:36.847920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1bfc-bb33-4d6e-b938-a85c1a9a38f2 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:36.854107 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 97/176] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:36.854779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1bfc-bb33-4d6e-b938-a85c1a9a38f2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:36.955861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:36.968656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a304-cb0b-40a2-9171-b64e6e02294d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:36.985298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1bfc-bb33-4d6e-b938-a85c1a9a38f2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:36.995683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:37.006665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedb79c-3def-4854-9919-be23b3d2113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:37.008445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb79c-3def-4854-9919-be23b3d2113e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.008445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb79c-3def-4854-9919-be23b3d2113e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.008445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb79c-3def-4854-9919-be23b3d2113e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.025533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9d1b8-1e7a-4b39-aebb-78206f287306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:37.026526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d1b8-1e7a-4b39-aebb-78206f287306 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.027092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d1b8-1e7a-4b39-aebb-78206f287306 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.027493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9d1b8-1e7a-4b39-aebb-78206f287306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.028295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9d1b8-1e7a-4b39-aebb-78206f287306 None admin] RBAC: Adding query filter params (role.id=a9232505007a45c580ef9414aee94847, scope.project.id=b5171171f9c44ffe896d40e40391d4a1, user.id=7d7ee37393394dd29269a36ed2bfd07c) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:37.028953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9d1b8-1e7a-4b39-aebb-78206f287306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:37.030506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9d1b8-1e7a-4b39-aebb-78206f287306 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:37.053500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 98/177] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:36 2022] GET /identity/v3/role_assignments?user.id=7d7ee37393394dd29269a36ed2bfd07c&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=a9232505007a45c580ef9414aee94847 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:37.053500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9d1b8-1e7a-4b39-aebb-78206f287306 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:37.095404 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedb79c-3def-4854-9919-be23b3d2113e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:37.096997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedb79c-3def-4854-9919-be23b3d2113e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:37.198595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:37.214516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9d1b8-1e7a-4b39-aebb-78206f287306 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:37.224247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 80/178] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:37.226008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b60e2-f50f-4852-8d02-f6e83ad776d9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.226008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b60e2-f50f-4852-8d02-f6e83ad776d9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.226276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b60e2-f50f-4852-8d02-f6e83ad776d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.246771 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-706b60e2-f50f-4852-8d02-f6e83ad776d9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:37.248197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-706b60e2-f50f-4852-8d02-f6e83ad776d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:37.250835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48a897-b512-43a0-9cf6-cd926bba788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:37.251566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48a897-b512-43a0-9cf6-cd926bba788e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.252788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48a897-b512-43a0-9cf6-cd926bba788e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.253074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48a897-b512-43a0-9cf6-cd926bba788e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.307292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:37.333889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 81/179] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:37.335150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38b2a8-2a82-49e8-b69f-6d5d0ca5cc41 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.335445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38b2a8-2a82-49e8-b69f-6d5d0ca5cc41 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.335719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38b2a8-2a82-49e8-b69f-6d5d0ca5cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.343145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48a897-b512-43a0-9cf6-cd926bba788e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:37.344880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48a897-b512-43a0-9cf6-cd926bba788e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:37.355476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1e38b2a8-2a82-49e8-b69f-6d5d0ca5cc41 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:37.356693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1e38b2a8-2a82-49e8-b69f-6d5d0ca5cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:37.426258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 82/180] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:37.427557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793d20-48ab-4441-89fb-9e5a6cbfc4b8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.427840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793d20-48ab-4441-89fb-9e5a6cbfc4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.428108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793d20-48ab-4441-89fb-9e5a6cbfc4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.446447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-df793d20-48ab-4441-89fb-9e5a6cbfc4b8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:37.447762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-df793d20-48ab-4441-89fb-9e5a6cbfc4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:37.469177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 99/181] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:37.471003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48a897-b512-43a0-9cf6-cd926bba788e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:37.497505 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:37.524912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 83/182] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:37.526273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bdaaa-204f-42a1-b6a1-6f3ff7dc27a4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.526552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bdaaa-204f-42a1-b6a1-6f3ff7dc27a4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.526822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bdaaa-204f-42a1-b6a1-6f3ff7dc27a4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.531993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 84/183] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:37.531993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bdaaa-204f-42a1-b6a1-6f3ff7dc27a4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:37.575228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:37.609977 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48a897-b512-43a0-9cf6-cd926bba788e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:37.643786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bdaaa-204f-42a1-b6a1-6f3ff7dc27a4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:37.648730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bcd09-40fa-4c92-bd1d-887abb24d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:37.649700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bcd09-40fa-4c92-bd1d-887abb24d3bf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.650133 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bcd09-40fa-4c92-bd1d-887abb24d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.650541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bcd09-40fa-4c92-bd1d-887abb24d3bf None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.651830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bcd09-40fa-4c92-bd1d-887abb24d3bf None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:37.653553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bcd09-40fa-4c92-bd1d-887abb24d3bf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:37.655657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 100/184] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:37 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:37.656964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef63a-1e3b-4e77-9f3e-a2e75c0b2dda None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.657381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef63a-1e3b-4e77-9f3e-a2e75c0b2dda None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.657848 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bef63a-1e3b-4e77-9f3e-a2e75c0b2dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.676957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-40bef63a-1e3b-4e77-9f3e-a2e75c0b2dda None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:37.678654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-40bef63a-1e3b-4e77-9f3e-a2e75c0b2dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:37.683428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce97b1a-5296-4727-b6dc-e622bc2fb3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:37.684175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce97b1a-5296-4727-b6dc-e622bc2fb3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.684549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce97b1a-5296-4727-b6dc-e622bc2fb3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.684917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce97b1a-5296-4727-b6dc-e622bc2fb3a8 None admin] PATH_INFO: `/v3/projects/d780990040124f46b85f1356627ea778` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.686170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce97b1a-5296-4727-b6dc-e622bc2fb3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=d780990040124f46b85f1356627ea778)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:37.687690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce97b1a-5296-4727-b6dc-e622bc2fb3a8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:37.689966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 85/185] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:37 2022] GET /identity/v3/projects/d780990040124f46b85f1356627ea778 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:37.691289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce97b1a-5296-4727-b6dc-e622bc2fb3a8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:37.752886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:37.759983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 101/186] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:37.759983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bef63a-1e3b-4e77-9f3e-a2e75c0b2dda None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:37.832750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce97b1a-5296-4727-b6dc-e622bc2fb3a8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:37.844985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:37.871281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5693cc-9e98-4032-9ee6-17af3f7926fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:37.872057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5693cc-9e98-4032-9ee6-17af3f7926fb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.872407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5693cc-9e98-4032-9ee6-17af3f7926fb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.872747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5693cc-9e98-4032-9ee6-17af3f7926fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.876422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bef63a-1e3b-4e77-9f3e-a2e75c0b2dda None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:37.884293 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5693cc-9e98-4032-9ee6-17af3f7926fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1b5693cc-9e98-4032-9ee6-17af3f7926fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:37.889188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:37.890295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 86/187] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:37.894287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5693cc-9e98-4032-9ee6-17af3f7926fb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:37.920457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df1d26-5081-4ece-96eb-0ed9b064e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:37.921062 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df1d26-5081-4ece-96eb-0ed9b064e787 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:37.921337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df1d26-5081-4ece-96eb-0ed9b064e787 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:37.921648 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df1d26-5081-4ece-96eb-0ed9b064e787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:37.922352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df1d26-5081-4ece-96eb-0ed9b064e787 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=b5171171f9c44ffe896d40e40391d4a1, user.id=57c499431d554526bf65401b415ad207) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:37.922655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df1d26-5081-4ece-96eb-0ed9b064e787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:37.924081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df1d26-5081-4ece-96eb-0ed9b064e787 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:37.930495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 102/188] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:37 2022] GET /identity/v3/role_assignments?user.id=57c499431d554526bf65401b415ad207&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:37.934827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df1d26-5081-4ece-96eb-0ed9b064e787 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.005512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5693cc-9e98-4032-9ee6-17af3f7926fb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.014622 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:38.044493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682919-531b-485f-9df0-7af793c661fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.045142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682919-531b-485f-9df0-7af793c661fd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.045419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682919-531b-485f-9df0-7af793c661fd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.045743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682919-531b-485f-9df0-7af793c661fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.046824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66682919-531b-485f-9df0-7af793c661fd None admin] RBAC: Adding query filter params (role.id=a9232505007a45c580ef9414aee94847, scope.project.id=d780990040124f46b85f1356627ea778, user.id=7d7ee37393394dd29269a36ed2bfd07c) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:38.046824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66682919-531b-485f-9df0-7af793c661fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:38.048245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66682919-531b-485f-9df0-7af793c661fd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:38.055470 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 87/189] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:37 2022] GET /identity/v3/role_assignments?user.id=7d7ee37393394dd29269a36ed2bfd07c&scope.project.id=d780990040124f46b85f1356627ea778&role.id=a9232505007a45c580ef9414aee94847 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:38.056581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682919-531b-485f-9df0-7af793c661fd None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.089064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df1d26-5081-4ece-96eb-0ed9b064e787 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.135961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993375f-b9a7-4dac-a996-672f3a25c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.136628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993375f-b9a7-4dac-a996-672f3a25c128 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.136909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993375f-b9a7-4dac-a996-672f3a25c128 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.137179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993375f-b9a7-4dac-a996-672f3a25c128 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.139577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:38.151550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993375f-b9a7-4dac-a996-672f3a25c128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1993375f-b9a7-4dac-a996-672f3a25c128 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:38.156573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:38.163587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 103/190] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:38.164374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993375f-b9a7-4dac-a996-672f3a25c128 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.211407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682919-531b-485f-9df0-7af793c661fd None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.250330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da7758-c881-45e7-9259-6cc557bf9bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.250962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da7758-c881-45e7-9259-6cc557bf9bfe None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.251241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da7758-c881-45e7-9259-6cc557bf9bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.251507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da7758-c881-45e7-9259-6cc557bf9bfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.264807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da7758-c881-45e7-9259-6cc557bf9bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-77da7758-c881-45e7-9259-6cc557bf9bfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:38.269455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:38.271225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:38.272139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 88/191] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:38.272866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da7758-c881-45e7-9259-6cc557bf9bfe None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.303651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993375f-b9a7-4dac-a996-672f3a25c128 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.307304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:38.338573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef42a21-4d73-4556-8cde-a68c6bb9b487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.339235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef42a21-4d73-4556-8cde-a68c6bb9b487 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.339518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef42a21-4d73-4556-8cde-a68c6bb9b487 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.339789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef42a21-4d73-4556-8cde-a68c6bb9b487 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.340460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef42a21-4d73-4556-8cde-a68c6bb9b487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:38.340759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef42a21-4d73-4556-8cde-a68c6bb9b487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:38.342226 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef42a21-4d73-4556-8cde-a68c6bb9b487 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:38.350371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 104/192] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:38.353211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef42a21-4d73-4556-8cde-a68c6bb9b487 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.383188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da7758-c881-45e7-9259-6cc557bf9bfe None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.406633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:38.417508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe84fe-dc19-44cb-bc1e-274c3bcf2744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.418147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe84fe-dc19-44cb-bc1e-274c3bcf2744 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.418430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe84fe-dc19-44cb-bc1e-274c3bcf2744 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.418705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe84fe-dc19-44cb-bc1e-274c3bcf2744 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.419809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe84fe-dc19-44cb-bc1e-274c3bcf2744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:38.421274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe84fe-dc19-44cb-bc1e-274c3bcf2744 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:38.422880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 89/193] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:38.423641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe84fe-dc19-44cb-bc1e-274c3bcf2744 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.452689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef42a21-4d73-4556-8cde-a68c6bb9b487 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.485258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8857ff9-8804-4b28-afce-796c99378e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.485888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8857ff9-8804-4b28-afce-796c99378e3e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.486161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8857ff9-8804-4b28-afce-796c99378e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.486425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8857ff9-8804-4b28-afce-796c99378e3e None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.487081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8857ff9-8804-4b28-afce-796c99378e3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:38.487376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8857ff9-8804-4b28-afce-796c99378e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:38.488731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8857ff9-8804-4b28-afce-796c99378e3e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:38.497162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 105/194] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:38.497973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8857ff9-8804-4b28-afce-796c99378e3e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.523533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:38.527253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe84fe-dc19-44cb-bc1e-274c3bcf2744 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.560844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b3f1-33ad-4d25-835a-f53336413f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.561435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b3f1-33ad-4d25-835a-f53336413f42 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.561731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b3f1-33ad-4d25-835a-f53336413f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.561999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b3f1-33ad-4d25-835a-f53336413f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.562655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b3f1-33ad-4d25-835a-f53336413f42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:38.562949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b3f1-33ad-4d25-835a-f53336413f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:38.564289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b3f1-33ad-4d25-835a-f53336413f42 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:38.571990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 90/195] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:38.572750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b3f1-33ad-4d25-835a-f53336413f42 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.600262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8857ff9-8804-4b28-afce-796c99378e3e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.616613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:38.632789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf4740-52f1-48f1-84ce-5fbed34212d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.633418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf4740-52f1-48f1-84ce-5fbed34212d8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.633722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf4740-52f1-48f1-84ce-5fbed34212d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.633994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf4740-52f1-48f1-84ce-5fbed34212d8 None admin] PATH_INFO: `/v3/users/1e0ca11b90c2456d8ec4e029176b5f84` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.647148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf4740-52f1-48f1-84ce-5fbed34212d8 None admin] RBAC: Authorizing `identity:get_user(user_id=1e0ca11b90c2456d8ec4e029176b5f84)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:38.648615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf4740-52f1-48f1-84ce-5fbed34212d8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:38.650464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 106/196] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/users/1e0ca11b90c2456d8ec4e029176b5f84 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:38.651240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf4740-52f1-48f1-84ce-5fbed34212d8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.674604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b3f1-33ad-4d25-835a-f53336413f42 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.707106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c3ef2-aeba-42a1-8193-e34362a58e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.708212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c3ef2-aeba-42a1-8193-e34362a58e7d None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.708477 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c3ef2-aeba-42a1-8193-e34362a58e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.708748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c3ef2-aeba-42a1-8193-e34362a58e7d None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.709392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c3ef2-aeba-42a1-8193-e34362a58e7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:38.710866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c3ef2-aeba-42a1-8193-e34362a58e7d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:38.750128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf4740-52f1-48f1-84ce-5fbed34212d8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.782466 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82700eae-db53-4e5e-a614-e6f75efd2172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.783028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82700eae-db53-4e5e-a614-e6f75efd2172 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.783323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82700eae-db53-4e5e-a614-e6f75efd2172 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.783593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82700eae-db53-4e5e-a614-e6f75efd2172 None admin] PATH_INFO: `/v3/users/38c7f7e0e83e42989e86c262725f433f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.784725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82700eae-db53-4e5e-a614-e6f75efd2172 None admin] RBAC: Authorizing `identity:get_user(user_id=38c7f7e0e83e42989e86c262725f433f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:38.786749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82700eae-db53-4e5e-a614-e6f75efd2172 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:38.788543 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 107/197] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/users/38c7f7e0e83e42989e86c262725f433f => generated 289 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:38.793526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82700eae-db53-4e5e-a614-e6f75efd2172 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.815014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 91/198] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:43:38 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:38.815836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c3ef2-aeba-42a1-8193-e34362a58e7d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.836717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:38.845192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:38.905170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82700eae-db53-4e5e-a614-e6f75efd2172 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.929134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c3ef2-aeba-42a1-8193-e34362a58e7d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:38.945506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ae8b-f186-4987-8e80-4d2abdc56c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.946144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ae8b-f186-4987-8e80-4d2abdc56c20 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.946422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ae8b-f186-4987-8e80-4d2abdc56c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.946685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ae8b-f186-4987-8e80-4d2abdc56c20 None admin] PATH_INFO: `/v3/users/1e0ca11b90c2456d8ec4e029176b5f84` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:38.947967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ae8b-f186-4987-8e80-4d2abdc56c20 None admin] RBAC: Authorizing `identity:get_user(user_id=1e0ca11b90c2456d8ec4e029176b5f84)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:38.949406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ae8b-f186-4987-8e80-4d2abdc56c20 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:38.955982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 108/199] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/users/1e0ca11b90c2456d8ec4e029176b5f84 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:38.955982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ae8b-f186-4987-8e80-4d2abdc56c20 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:38.973104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37581fdc-722c-47bd-a20c-0a8ae3e336e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:38.974570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37581fdc-722c-47bd-a20c-0a8ae3e336e1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:38.976035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37581fdc-722c-47bd-a20c-0a8ae3e336e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:38.976035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37581fdc-722c-47bd-a20c-0a8ae3e336e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:39.057567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37581fdc-722c-47bd-a20c-0a8ae3e336e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:39.059297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37581fdc-722c-47bd-a20c-0a8ae3e336e1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:39.068051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ae8b-f186-4987-8e80-4d2abdc56c20 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:39.116325 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321407c-7a4b-4cc6-b53f-83b612ec54b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:39.117015 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321407c-7a4b-4cc6-b53f-83b612ec54b5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:39.117370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321407c-7a4b-4cc6-b53f-83b612ec54b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:39.117682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321407c-7a4b-4cc6-b53f-83b612ec54b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:39.183860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.191765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 92/200] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:39.195953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37581fdc-722c-47bd-a20c-0a8ae3e336e1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:39.205358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321407c-7a4b-4cc6-b53f-83b612ec54b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:39.207697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321407c-7a4b-4cc6-b53f-83b612ec54b5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:39.217083 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.305111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37581fdc-722c-47bd-a20c-0a8ae3e336e1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:39.329727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.347640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 109/201] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:39.349397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321407c-7a4b-4cc6-b53f-83b612ec54b5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:39.351048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e3dc7-e90b-4d2e-a39b-77957b588f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:39.351995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e3dc7-e90b-4d2e-a39b-77957b588f04 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:39.352496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e3dc7-e90b-4d2e-a39b-77957b588f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:39.353238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e3dc7-e90b-4d2e-a39b-77957b588f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:39.370074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.454843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e3dc7-e90b-4d2e-a39b-77957b588f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:39.457537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e3dc7-e90b-4d2e-a39b-77957b588f04 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:39.459905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321407c-7a4b-4cc6-b53f-83b612ec54b5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:39.505374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994157d-599c-402a-87f4-04abf37f9eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:39.506347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994157d-599c-402a-87f4-04abf37f9eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:39.506776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994157d-599c-402a-87f4-04abf37f9eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:39.507271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994157d-599c-402a-87f4-04abf37f9eb6 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:39.508813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994157d-599c-402a-87f4-04abf37f9eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:39.510529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994157d-599c-402a-87f4-04abf37f9eb6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:39.512430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 110/202] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:39 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:39.513558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994157d-599c-402a-87f4-04abf37f9eb6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:39.569841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 93/203] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:39.569841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e3dc7-e90b-4d2e-a39b-77957b588f04 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:39.585169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.608827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.631063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994157d-599c-402a-87f4-04abf37f9eb6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:39.670711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185a7b-8303-4f62-8d98-a1dbeeba6f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:39.671609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185a7b-8303-4f62-8d98-a1dbeeba6f25 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:39.672069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185a7b-8303-4f62-8d98-a1dbeeba6f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:39.672513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185a7b-8303-4f62-8d98-a1dbeeba6f25 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:39.672665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e3dc7-e90b-4d2e-a39b-77957b588f04 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:39.673985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72185a7b-8303-4f62-8d98-a1dbeeba6f25 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:39.675733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72185a7b-8303-4f62-8d98-a1dbeeba6f25 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:39.677975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 111/204] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:39 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:39.678926 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185a7b-8303-4f62-8d98-a1dbeeba6f25 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:39.715010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c76c4-4990-476a-bb2d-da921a063b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:39.715706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c76c4-4990-476a-bb2d-da921a063b6a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:39.715980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c76c4-4990-476a-bb2d-da921a063b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:39.716254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c76c4-4990-476a-bb2d-da921a063b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:39.717567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c76c4-4990-476a-bb2d-da921a063b6a None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=97d4b1bf1bff4d36a820888731015eaf, user.id=1e0ca11b90c2456d8ec4e029176b5f84) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:39.717567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c76c4-4990-476a-bb2d-da921a063b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:39.718807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c76c4-4990-476a-bb2d-da921a063b6a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:39.724276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 94/205] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:39 2022] GET /identity/v3/role_assignments?user.id=1e0ca11b90c2456d8ec4e029176b5f84&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:39.725078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c76c4-4990-476a-bb2d-da921a063b6a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:39.791923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185a7b-8303-4f62-8d98-a1dbeeba6f25 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:39.814121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.832454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149875e-8e75-445d-a03b-9dded8f1d854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:39.834230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149875e-8e75-445d-a03b-9dded8f1d854 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:39.834692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149875e-8e75-445d-a03b-9dded8f1d854 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:39.835118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149875e-8e75-445d-a03b-9dded8f1d854 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:39.836235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c76c4-4990-476a-bb2d-da921a063b6a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:39.836912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149875e-8e75-445d-a03b-9dded8f1d854 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:39.838667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149875e-8e75-445d-a03b-9dded8f1d854 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:39.840600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 112/206] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:39 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:39.849766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149875e-8e75-445d-a03b-9dded8f1d854 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:39.877976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.910280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4e57a-c0ed-4480-96c9-03e137d5ba33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:39.911479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4e57a-c0ed-4480-96c9-03e137d5ba33 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:39.911697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4e57a-c0ed-4480-96c9-03e137d5ba33 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:39.911962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4e57a-c0ed-4480-96c9-03e137d5ba33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:39.913112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4e57a-c0ed-4480-96c9-03e137d5ba33 None admin] RBAC: Adding query filter params (role.id=1028072c80a14a309ff74e79948a9b25, scope.project.id=b5171171f9c44ffe896d40e40391d4a1, user.id=38c7f7e0e83e42989e86c262725f433f) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:39.913422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4e57a-c0ed-4480-96c9-03e137d5ba33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:39.914893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4e57a-c0ed-4480-96c9-03e137d5ba33 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:39.930444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 95/207] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:39 2022] GET /identity/v3/role_assignments?user.id=38c7f7e0e83e42989e86c262725f433f&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=1028072c80a14a309ff74e79948a9b25 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:39.968611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149875e-8e75-445d-a03b-9dded8f1d854 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:40.008577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b065ae-4f04-4903-b83f-f3246fc38515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:40.009495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b065ae-4f04-4903-b83f-f3246fc38515 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:40.009934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b065ae-4f04-4903-b83f-f3246fc38515 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:40.010371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b065ae-4f04-4903-b83f-f3246fc38515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:40.011263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b065ae-4f04-4903-b83f-f3246fc38515 None admin] RBAC: Adding query filter params (role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=97d4b1bf1bff4d36a820888731015eaf, user.id=1e0ca11b90c2456d8ec4e029176b5f84) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:40.011717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b065ae-4f04-4903-b83f-f3246fc38515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:40.013354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b065ae-4f04-4903-b83f-f3246fc38515 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:40.019942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 113/208] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:39 2022] GET /identity/v3/role_assignments?user.id=1e0ca11b90c2456d8ec4e029176b5f84&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:41.015850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3bbbf-a228-490f-b2db-89d459f5bc1f None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.016395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3bbbf-a228-490f-b2db-89d459f5bc1f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.016675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3bbbf-a228-490f-b2db-89d459f5bc1f None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.018424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 96/209] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:41.024511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10c94-4981-4b86-bbb0-6776506e813a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.024952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10c94-4981-4b86-bbb0-6776506e813a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.025244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10c94-4981-4b86-bbb0-6776506e813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.039807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8b3e-0334-4e39-b0fe-8cedaacf8102 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.040156 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8b3e-0334-4e39-b0fe-8cedaacf8102 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.040339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8b3e-0334-4e39-b0fe-8cedaacf8102 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.042059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 97/210] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:41.047620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037296-2f1c-424b-b4e5-0f7ff2e1d597 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.047904 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037296-2f1c-424b-b4e5-0f7ff2e1d597 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.048172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037296-2f1c-424b-b4e5-0f7ff2e1d597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.050210 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-00b10c94-4981-4b86-bbb0-6776506e813a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:41.052427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-00b10c94-4981-4b86-bbb0-6776506e813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:41.066752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-97037296-2f1c-424b-b4e5-0f7ff2e1d597 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:41.068141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-97037296-2f1c-424b-b4e5-0f7ff2e1d597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:41.144753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 114/211] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:41.150089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 98/212] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:41.425654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97037296-2f1c-424b-b4e5-0f7ff2e1d597 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:41.425835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b10c94-4981-4b86-bbb0-6776506e813a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:41.441369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:41.511584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:41.539666 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97037296-2f1c-424b-b4e5-0f7ff2e1d597 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:41.564202 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b10c94-4981-4b86-bbb0-6776506e813a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:41.580026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827099b-9d37-46a5-b976-1984e5449f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:41.581148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827099b-9d37-46a5-b976-1984e5449f14 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.582003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827099b-9d37-46a5-b976-1984e5449f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.583351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827099b-9d37-46a5-b976-1984e5449f14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.584991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827099b-9d37-46a5-b976-1984e5449f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:41.586925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827099b-9d37-46a5-b976-1984e5449f14 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:41.589596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 99/213] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:41.595864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827099b-9d37-46a5-b976-1984e5449f14 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:41.611649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100e91-2892-4053-b02a-bd5c31cd4378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:41.612537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100e91-2892-4053-b02a-bd5c31cd4378 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.612816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100e91-2892-4053-b02a-bd5c31cd4378 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.613084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100e91-2892-4053-b02a-bd5c31cd4378 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.627070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b100e91-2892-4053-b02a-bd5c31cd4378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-8b100e91-2892-4053-b02a-bd5c31cd4378 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:41.633506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:41.634446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:41.635281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 115/214] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:41.641990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100e91-2892-4053-b02a-bd5c31cd4378 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:41.715954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827099b-9d37-46a5-b976-1984e5449f14 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:41.736354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:41.755682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cd40e-c1e2-4d1d-9434-2af8cb7933b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:41.757642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cd40e-c1e2-4d1d-9434-2af8cb7933b5 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.757642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cd40e-c1e2-4d1d-9434-2af8cb7933b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.757642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cd40e-c1e2-4d1d-9434-2af8cb7933b5 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.758294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cd40e-c1e2-4d1d-9434-2af8cb7933b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:41.759948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cd40e-c1e2-4d1d-9434-2af8cb7933b5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:41.773772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100e91-2892-4053-b02a-bd5c31cd4378 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:41.810906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c3f7-413d-482f-9e2d-b832803f1e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:41.811525 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c3f7-413d-482f-9e2d-b832803f1e4c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.812019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c3f7-413d-482f-9e2d-b832803f1e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.812385 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c3f7-413d-482f-9e2d-b832803f1e4c None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.813111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0c3f7-413d-482f-9e2d-b832803f1e4c None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:41.813411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0c3f7-413d-482f-9e2d-b832803f1e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:41.814861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0c3f7-413d-482f-9e2d-b832803f1e4c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:41.824844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 116/215] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:41.830511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c3f7-413d-482f-9e2d-b832803f1e4c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:41.853027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:41.866935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 100/216] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:43:41 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:41.930971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf52fa6-69f8-4c48-9e87-db81de169507 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.931149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf52fa6-69f8-4c48-9e87-db81de169507 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.931459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf52fa6-69f8-4c48-9e87-db81de169507 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.932950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 101/217] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:41.938684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31920b-411a-40ae-b9e9-a136a5e47aec None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:41.938972 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31920b-411a-40ae-b9e9-a136a5e47aec None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:41.939265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31920b-411a-40ae-b9e9-a136a5e47aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:41.956488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c3f7-413d-482f-9e2d-b832803f1e4c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:41.959026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3b31920b-411a-40ae-b9e9-a136a5e47aec None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:41.960532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3b31920b-411a-40ae-b9e9-a136a5e47aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:41.997611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:42.005414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f93478-596f-4805-ac30-cd57501d7d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:42.006599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f93478-596f-4805-ac30-cd57501d7d5a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.006879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f93478-596f-4805-ac30-cd57501d7d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.007154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f93478-596f-4805-ac30-cd57501d7d5a None admin] PATH_INFO: `/v3/users/94cc4a345484463ab6855cffd6dbc7a2` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.027310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f93478-596f-4805-ac30-cd57501d7d5a None admin] RBAC: Authorizing `identity:get_user(user_id=94cc4a345484463ab6855cffd6dbc7a2)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:42.029322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f93478-596f-4805-ac30-cd57501d7d5a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:42.031757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 117/218] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:41 2022] GET /identity/v3/users/94cc4a345484463ab6855cffd6dbc7a2 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:42.038727 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f93478-596f-4805-ac30-cd57501d7d5a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:42.055467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 102/219] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:42.057118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c65044-3ca4-4d39-8d82-261cb6cc3d8d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.057118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c65044-3ca4-4d39-8d82-261cb6cc3d8d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.057285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c65044-3ca4-4d39-8d82-261cb6cc3d8d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.058515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 103/220] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:42.064496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79822c-168d-4e9a-9d1e-61e6faf82110 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.064765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79822c-168d-4e9a-9d1e-61e6faf82110 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.065029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79822c-168d-4e9a-9d1e-61e6faf82110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.083143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fe79822c-168d-4e9a-9d1e-61e6faf82110 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:42.084313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fe79822c-168d-4e9a-9d1e-61e6faf82110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:42.175423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 104/221] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:42.177649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f93478-596f-4805-ac30-cd57501d7d5a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:42.216154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c1af8-dd38-415b-be2a-c0db2e28ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:42.216691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c1af8-dd38-415b-be2a-c0db2e28ba43 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.216964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c1af8-dd38-415b-be2a-c0db2e28ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.217230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c1af8-dd38-415b-be2a-c0db2e28ba43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.283456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:42.295095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c1af8-dd38-415b-be2a-c0db2e28ba43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:42.296604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c1af8-dd38-415b-be2a-c0db2e28ba43 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:42.343657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79822c-168d-4e9a-9d1e-61e6faf82110 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:42.411516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 118/222] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:42.417902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c1af8-dd38-415b-be2a-c0db2e28ba43 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:42.445070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:42.500396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79822c-168d-4e9a-9d1e-61e6faf82110 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:42.539208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a8197-51f0-439a-ba1c-7cd5a53289c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:42.539847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a8197-51f0-439a-ba1c-7cd5a53289c8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.540122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a8197-51f0-439a-ba1c-7cd5a53289c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.540388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a8197-51f0-439a-ba1c-7cd5a53289c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.551009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a8197-51f0-439a-ba1c-7cd5a53289c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:42.553892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-178a8197-51f0-439a-ba1c-7cd5a53289c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:42.556341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:42.557218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 105/223] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:42.562042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a8197-51f0-439a-ba1c-7cd5a53289c8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:42.574563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c1af8-dd38-415b-be2a-c0db2e28ba43 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:42.621090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9d26-6f0b-4a72-8878-f8e81b5c4c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:42.621901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9d26-6f0b-4a72-8878-f8e81b5c4c12 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.622291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9d26-6f0b-4a72-8878-f8e81b5c4c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.623203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9d26-6f0b-4a72-8878-f8e81b5c4c12 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.624772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db9d26-6f0b-4a72-8878-f8e81b5c4c12 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:42.627191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db9d26-6f0b-4a72-8878-f8e81b5c4c12 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:42.633498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 119/224] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:42 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:42.633498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9d26-6f0b-4a72-8878-f8e81b5c4c12 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:42.682735 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a8197-51f0-439a-ba1c-7cd5a53289c8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:42.706768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:42.728720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543ac1-7ef2-4123-bfde-98cb815848b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:42.729521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543ac1-7ef2-4123-bfde-98cb815848b4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.730024 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543ac1-7ef2-4123-bfde-98cb815848b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.730298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70543ac1-7ef2-4123-bfde-98cb815848b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.746065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70543ac1-7ef2-4123-bfde-98cb815848b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-70543ac1-7ef2-4123-bfde-98cb815848b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:42.753087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:42.753998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:42.755317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:42.755941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9d26-6f0b-4a72-8878-f8e81b5c4c12 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:42.758342 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 106/225] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:43:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:42.759290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543ac1-7ef2-4123-bfde-98cb815848b4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:42.799211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c78f-4845-45e0-888e-ab87b9a0e5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:42.799962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c78f-4845-45e0-888e-ab87b9a0e5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.800336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c78f-4845-45e0-888e-ab87b9a0e5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.800703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c78f-4845-45e0-888e-ab87b9a0e5d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.801546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18c78f-4845-45e0-888e-ab87b9a0e5d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:42.801941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18c78f-4845-45e0-888e-ab87b9a0e5d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:42.803667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18c78f-4845-45e0-888e-ab87b9a0e5d1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:42.812844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 120/226] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:42.814853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c78f-4845-45e0-888e-ab87b9a0e5d1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:42.849003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:42.879912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70543ac1-7ef2-4123-bfde-98cb815848b4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:42.916454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bafe2-b190-44bf-92db-5290115ca641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:42.917235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bafe2-b190-44bf-92db-5290115ca641 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.917806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bafe2-b190-44bf-92db-5290115ca641 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.917996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bafe2-b190-44bf-92db-5290115ca641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.918835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bafe2-b190-44bf-92db-5290115ca641 None admin] RBAC: Adding query filter params (role.id=a9232505007a45c580ef9414aee94847, scope.project.id=97d4b1bf1bff4d36a820888731015eaf, user.id=94cc4a345484463ab6855cffd6dbc7a2) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:42.919245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bafe2-b190-44bf-92db-5290115ca641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:42.920766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bafe2-b190-44bf-92db-5290115ca641 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:42.926662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 107/227] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:42 2022] GET /identity/v3/role_assignments?user.id=94cc4a345484463ab6855cffd6dbc7a2&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=a9232505007a45c580ef9414aee94847 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:42.927720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bafe2-b190-44bf-92db-5290115ca641 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:42.939088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c78f-4845-45e0-888e-ab87b9a0e5d1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:42.975819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:42.979853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148e43-f444-4626-92be-c96527efe9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:42.980732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148e43-f444-4626-92be-c96527efe9af None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:42.981207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148e43-f444-4626-92be-c96527efe9af None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:42.981705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0148e43-f444-4626-92be-c96527efe9af None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:42.982623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0148e43-f444-4626-92be-c96527efe9af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:42.983068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0148e43-f444-4626-92be-c96527efe9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:42.988467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0148e43-f444-4626-92be-c96527efe9af None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:42.994983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 121/228] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:43:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:43.005093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148e43-f444-4626-92be-c96527efe9af None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:43.097172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bafe2-b190-44bf-92db-5290115ca641 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:43.151700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:43.172435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0148e43-f444-4626-92be-c96527efe9af None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:43.187561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f15f1-9c07-44ab-a71e-d09748004eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:43.188209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f15f1-9c07-44ab-a71e-d09748004eda None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:43.188486 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f15f1-9c07-44ab-a71e-d09748004eda None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:43.188759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f15f1-9c07-44ab-a71e-d09748004eda None admin] PATH_INFO: `/v3/users/1e0ca11b90c2456d8ec4e029176b5f84` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:43.194058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f15f1-9c07-44ab-a71e-d09748004eda None admin] RBAC: Authorizing `identity:get_user(user_id=1e0ca11b90c2456d8ec4e029176b5f84)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:43.195515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f15f1-9c07-44ab-a71e-d09748004eda None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:43.197430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 108/229] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:42 2022] GET /identity/v3/users/1e0ca11b90c2456d8ec4e029176b5f84 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:43.202876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f15f1-9c07-44ab-a71e-d09748004eda None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:43.217669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437bcf1-452f-4cfa-9d70-99505bc8718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:43.218498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437bcf1-452f-4cfa-9d70-99505bc8718e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:43.222520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437bcf1-452f-4cfa-9d70-99505bc8718e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:43.222968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437bcf1-452f-4cfa-9d70-99505bc8718e None admin] PATH_INFO: `/v3/users/1e0ca11b90c2456d8ec4e029176b5f84` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:43.224975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437bcf1-452f-4cfa-9d70-99505bc8718e None admin] RBAC: Authorizing `identity:get_user(user_id=1e0ca11b90c2456d8ec4e029176b5f84)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:43.228979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437bcf1-452f-4cfa-9d70-99505bc8718e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:43.230798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 122/230] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:43 2022] GET /identity/v3/users/1e0ca11b90c2456d8ec4e029176b5f84 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:43.236471 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437bcf1-452f-4cfa-9d70-99505bc8718e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:43.428060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437bcf1-452f-4cfa-9d70-99505bc8718e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:43.452980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f15f1-9c07-44ab-a71e-d09748004eda None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:43.477205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:43.505454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f7f21-d26f-4111-9f07-07983a85ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:43.506111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7f21-d26f-4111-9f07-07983a85ce97 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:43.506414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7f21-d26f-4111-9f07-07983a85ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:43.506638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7f21-d26f-4111-9f07-07983a85ce97 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:43.510479 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f7f21-d26f-4111-9f07-07983a85ce97 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:43.511935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f7f21-d26f-4111-9f07-07983a85ce97 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:43.517443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 123/231] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:43 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:43.522958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f7f21-d26f-4111-9f07-07983a85ce97 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:43.525108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b060a-90ec-4673-b034-246f21e3e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:43.526131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b060a-90ec-4673-b034-246f21e3e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:43.526708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b060a-90ec-4673-b034-246f21e3e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:43.527175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b060a-90ec-4673-b034-246f21e3e3c3 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:43.528563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b060a-90ec-4673-b034-246f21e3e3c3 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:43.530305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b060a-90ec-4673-b034-246f21e3e3c3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:43.532264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 109/232] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:43 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:43.539048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b060a-90ec-4673-b034-246f21e3e3c3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:43.560641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:43.711045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b060a-90ec-4673-b034-246f21e3e3c3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:43.735794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f7f21-d26f-4111-9f07-07983a85ce97 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:43.783601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba4b94-46f1-4cb2-ba8e-7146039a0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:43.784267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba4b94-46f1-4cb2-ba8e-7146039a0462 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:43.784543 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba4b94-46f1-4cb2-ba8e-7146039a0462 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:43.784818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba4b94-46f1-4cb2-ba8e-7146039a0462 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf/users/1e0ca11b90c2456d8ec4e029176b5f84/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:43.789336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f40485-75f1-4bfb-9f08-ee8650f850c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:43.790019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f40485-75f1-4bfb-9f08-ee8650f850c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:43.790293 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f40485-75f1-4bfb-9f08-ee8650f850c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:43.790564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f40485-75f1-4bfb-9f08-ee8650f850c9 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf/users/1e0ca11b90c2456d8ec4e029176b5f84/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:43.791950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba4b94-46f1-4cb2-ba8e-7146039a0462 None admin] RBAC: Authorizing `identity:create_grant(project_id=97d4b1bf1bff4d36a820888731015eaf, user_id=1e0ca11b90c2456d8ec4e029176b5f84, role_id=6a99e3ee2e8546c8a6cc6f4e33997bfd)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:43.793395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba4b94-46f1-4cb2-ba8e-7146039a0462 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:43.796575 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f40485-75f1-4bfb-9f08-ee8650f850c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=97d4b1bf1bff4d36a820888731015eaf, user_id=1e0ca11b90c2456d8ec4e029176b5f84, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:43.798075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f40485-75f1-4bfb-9f08-ee8650f850c9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:43.870266 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 124/233] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:43:43 2022] PUT /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf/users/1e0ca11b90c2456d8ec4e029176b5f84/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:43.898788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 110/234] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:43:43 2022] PUT /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf/users/1e0ca11b90c2456d8ec4e029176b5f84/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:43:44.240477 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e8a62-be97-4504-abdf-2bdfa4b580bb None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:44.241009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e8a62-be97-4504-abdf-2bdfa4b580bb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:44.241009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e8a62-be97-4504-abdf-2bdfa4b580bb None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:44.242632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 125/235] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:44.248102 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144c1a-4422-48af-8040-8f1aee4b726f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:44.248513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144c1a-4422-48af-8040-8f1aee4b726f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:44.248698 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144c1a-4422-48af-8040-8f1aee4b726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:44.272545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b3144c1a-4422-48af-8040-8f1aee4b726f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:44.273774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b3144c1a-4422-48af-8040-8f1aee4b726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:44.313564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:44.371944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 111/236] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:44.401678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c603e9-6c84-42c7-a695-e5108c6d38f2 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:44.401988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c603e9-6c84-42c7-a695-e5108c6d38f2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:44.402231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c603e9-6c84-42c7-a695-e5108c6d38f2 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:44.403845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 126/237] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:44.409318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2c3b-d013-4eb1-81c8-3b43c5814d86 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:44.409672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2c3b-d013-4eb1-81c8-3b43c5814d86 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:44.410048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2c3b-d013-4eb1-81c8-3b43c5814d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:44.431318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fd0c2c3b-d013-4eb1-81c8-3b43c5814d86 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:44.432519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fd0c2c3b-d013-4eb1-81c8-3b43c5814d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:44.517212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 112/238] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:44.712083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c603e9-6c84-42c7-a695-e5108c6d38f2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:44.813931 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:44.843725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c603e9-6c84-42c7-a695-e5108c6d38f2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:44.900049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9237ac5-130a-4092-b5cb-16cc0af4e58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:44.900698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9237ac5-130a-4092-b5cb-16cc0af4e58a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:44.900974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9237ac5-130a-4092-b5cb-16cc0af4e58a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:44.901240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9237ac5-130a-4092-b5cb-16cc0af4e58a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:44.902412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9237ac5-130a-4092-b5cb-16cc0af4e58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:44.903983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9237ac5-130a-4092-b5cb-16cc0af4e58a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:44.906502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 127/239] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:44.913434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c2c3b-d013-4eb1-81c8-3b43c5814d86 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:44.953802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9237ac5-130a-4092-b5cb-16cc0af4e58a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:45.038837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c2c3b-d013-4eb1-81c8-3b43c5814d86 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:45.041933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:45.107916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc83954-631e-4e6f-8bc6-7665a88dc1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:45.108444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83954-631e-4e6f-8bc6-7665a88dc1d0 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:45.108718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83954-631e-4e6f-8bc6-7665a88dc1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:45.108981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83954-631e-4e6f-8bc6-7665a88dc1d0 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:45.109768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc83954-631e-4e6f-8bc6-7665a88dc1d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:45.111244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc83954-631e-4e6f-8bc6-7665a88dc1d0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:45.150084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9237ac5-130a-4092-b5cb-16cc0af4e58a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:45.189909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac64ac-d5f0-4dab-a414-01c268f959b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:45.190551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac64ac-d5f0-4dab-a414-01c268f959b8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:45.191352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac64ac-d5f0-4dab-a414-01c268f959b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:45.191352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac64ac-d5f0-4dab-a414-01c268f959b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:45.204400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac64ac-d5f0-4dab-a414-01c268f959b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-e8ac64ac-d5f0-4dab-a414-01c268f959b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:45.210038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:45.210999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:45.211787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 128/240] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:45.218120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac64ac-d5f0-4dab-a414-01c268f959b8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:45.220993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 113/241] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:43:44 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:43:45.232714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:45.264248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5b18e-9a78-40f6-9eec-ba88f0b45874 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:45.264880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5b18e-9a78-40f6-9eec-ba88f0b45874 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:45.264880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5b18e-9a78-40f6-9eec-ba88f0b45874 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:45.266385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 114/242] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:45.273916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cb2b1-53a2-484b-b4c6-d20703d46f63 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:45.273916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cb2b1-53a2-484b-b4c6-d20703d46f63 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:45.273916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cb2b1-53a2-484b-b4c6-d20703d46f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:45.318718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dd2cb2b1-53a2-484b-b4c6-d20703d46f63 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:45.321389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dd2cb2b1-53a2-484b-b4c6-d20703d46f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:45.359664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac64ac-d5f0-4dab-a414-01c268f959b8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:45.405917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e41488-ac3e-42d1-9c2f-73da7d2a1ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:45.406592 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e41488-ac3e-42d1-9c2f-73da7d2a1ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:45.406870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e41488-ac3e-42d1-9c2f-73da7d2a1ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:45.407138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e41488-ac3e-42d1-9c2f-73da7d2a1ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:45.407946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e41488-ac3e-42d1-9c2f-73da7d2a1ca5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:45.408252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e41488-ac3e-42d1-9c2f-73da7d2a1ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:45.409882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e41488-ac3e-42d1-9c2f-73da7d2a1ca5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:45.420984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 129/243] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:45.426680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e41488-ac3e-42d1-9c2f-73da7d2a1ca5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:45.450879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 115/244] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:45.514765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:45.551309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e41488-ac3e-42d1-9c2f-73da7d2a1ca5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:45.587679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e426d-d631-403d-816a-9140b9de59c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:45.588368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e426d-d631-403d-816a-9140b9de59c7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:45.588647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e426d-d631-403d-816a-9140b9de59c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:45.588916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e426d-d631-403d-816a-9140b9de59c7 None admin] PATH_INFO: `/v3/users/0542c1d5d05844aaadcae31b4723ee7b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:45.604297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e426d-d631-403d-816a-9140b9de59c7 None admin] RBAC: Authorizing `identity:get_user(user_id=0542c1d5d05844aaadcae31b4723ee7b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:45.605805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e426d-d631-403d-816a-9140b9de59c7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:45.607437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 130/245] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:45 2022] GET /identity/v3/users/0542c1d5d05844aaadcae31b4723ee7b => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:45.613227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cb2b1-53a2-484b-b4c6-d20703d46f63 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:45.702465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:45.718581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cb2b1-53a2-484b-b4c6-d20703d46f63 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:45.754168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51ff2-b5ee-49ef-94f0-f704c15bef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:45.755659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51ff2-b5ee-49ef-94f0-f704c15bef6f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:45.755948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51ff2-b5ee-49ef-94f0-f704c15bef6f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:45.756221 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51ff2-b5ee-49ef-94f0-f704c15bef6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:45.780243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e426d-d631-403d-816a-9140b9de59c7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:45.851878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51ff2-b5ee-49ef-94f0-f704c15bef6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:45.853352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51ff2-b5ee-49ef-94f0-f704c15bef6f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:45.915893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e426d-d631-403d-816a-9140b9de59c7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:45.943790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:45.948765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:45.960553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20384229-fcd5-4df0-a4d7-820dc59967a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:45.961554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384229-fcd5-4df0-a4d7-820dc59967a5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:45.962026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384229-fcd5-4df0-a4d7-820dc59967a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:45.962179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 116/246] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:45.965491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20384229-fcd5-4df0-a4d7-820dc59967a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:45.968216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51ff2-b5ee-49ef-94f0-f704c15bef6f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:45.976287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20384229-fcd5-4df0-a4d7-820dc59967a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-20384229-fcd5-4df0-a4d7-820dc59967a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:45.982672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:45.983657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:45.984636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:45.986941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 131/247] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:45.995097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20384229-fcd5-4df0-a4d7-820dc59967a5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:46.109646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51ff2-b5ee-49ef-94f0-f704c15bef6f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:46.120366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20384229-fcd5-4df0-a4d7-820dc59967a5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:46.152888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a762-903f-49fc-b427-11443d71cd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:46.153948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a762-903f-49fc-b427-11443d71cd64 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.154662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a762-903f-49fc-b427-11443d71cd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.155091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a762-903f-49fc-b427-11443d71cd64 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.156583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a762-903f-49fc-b427-11443d71cd64 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:46.158427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a762-903f-49fc-b427-11443d71cd64 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:46.160078 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd105445-024b-4f3f-8976-6471b07e74b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:46.161271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 117/248] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:45 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:46.166023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd105445-024b-4f3f-8976-6471b07e74b3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.166561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd105445-024b-4f3f-8976-6471b07e74b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.167031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd105445-024b-4f3f-8976-6471b07e74b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.167929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd105445-024b-4f3f-8976-6471b07e74b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:46.168429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd105445-024b-4f3f-8976-6471b07e74b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:46.170346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a762-903f-49fc-b427-11443d71cd64 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:46.170467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd105445-024b-4f3f-8976-6471b07e74b3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:46.180229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 132/249] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:46.187204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd105445-024b-4f3f-8976-6471b07e74b3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:46.239576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:46.249598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:46.300016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a762-903f-49fc-b427-11443d71cd64 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:46.324589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd105445-024b-4f3f-8976-6471b07e74b3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:46.373950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c0ad-db5d-468e-9238-32783aac7877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:46.374839 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c0ad-db5d-468e-9238-32783aac7877 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.380190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c0ad-db5d-468e-9238-32783aac7877 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.380190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c0ad-db5d-468e-9238-32783aac7877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.380190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449c0ad-db5d-468e-9238-32783aac7877 None admin] RBAC: Adding query filter params (role.id=1028072c80a14a309ff74e79948a9b25, scope.project.id=97d4b1bf1bff4d36a820888731015eaf, user.id=0542c1d5d05844aaadcae31b4723ee7b) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:46.380190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449c0ad-db5d-468e-9238-32783aac7877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:46.380190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449c0ad-db5d-468e-9238-32783aac7877 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:46.389067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 118/250] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:46 2022] GET /identity/v3/role_assignments?user.id=0542c1d5d05844aaadcae31b4723ee7b&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=1028072c80a14a309ff74e79948a9b25 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:46.391819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e4b8e-61a3-4d1f-a190-716b9360d02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:46.393135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e4b8e-61a3-4d1f-a190-716b9360d02d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.393601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e4b8e-61a3-4d1f-a190-716b9360d02d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.394014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e4b8e-61a3-4d1f-a190-716b9360d02d None admin] PATH_INFO: `/v3/users/94cc4a345484463ab6855cffd6dbc7a2` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.395552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e4b8e-61a3-4d1f-a190-716b9360d02d None admin] RBAC: Authorizing `identity:get_user(user_id=94cc4a345484463ab6855cffd6dbc7a2)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:46.397267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e4b8e-61a3-4d1f-a190-716b9360d02d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:46.399555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 133/251] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:46 2022] GET /identity/v3/users/94cc4a345484463ab6855cffd6dbc7a2 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:46.405501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c0ad-db5d-468e-9238-32783aac7877 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:46.435191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59934b42-ac5d-46b5-8d2f-6f81139c27c9 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.435820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59934b42-ac5d-46b5-8d2f-6f81139c27c9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.436302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59934b42-ac5d-46b5-8d2f-6f81139c27c9 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.438304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 134/252] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:46.443781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd8d3e-6d0c-4eb5-b30a-08024e21afd3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.444409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd8d3e-6d0c-4eb5-b30a-08024e21afd3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.444876 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd8d3e-6d0c-4eb5-b30a-08024e21afd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.473791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e8cd8d3e-6d0c-4eb5-b30a-08024e21afd3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:46.477164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e8cd8d3e-6d0c-4eb5-b30a-08024e21afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:46.583725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c0ad-db5d-468e-9238-32783aac7877 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:46.611995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 135/253] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:46.613718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0ef6c-0e5b-4949-bd0d-f9447e3608d0 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.614430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0ef6c-0e5b-4949-bd0d-f9447e3608d0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.614900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0ef6c-0e5b-4949-bd0d-f9447e3608d0 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.618901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 136/254] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:46.624762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95879d8-17d6-4cec-ace8-f55f9d326d73 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.625318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95879d8-17d6-4cec-ace8-f55f9d326d73 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.625839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95879d8-17d6-4cec-ace8-f55f9d326d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.630108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:46.653053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e95879d8-17d6-4cec-ace8-f55f9d326d73 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:46.654621 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e95879d8-17d6-4cec-ace8-f55f9d326d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:46.659255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500d5e8-e0bf-4336-9e61-43ae745ca450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:46.659912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500d5e8-e0bf-4336-9e61-43ae745ca450 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.660196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500d5e8-e0bf-4336-9e61-43ae745ca450 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.660502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500d5e8-e0bf-4336-9e61-43ae745ca450 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.662186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500d5e8-e0bf-4336-9e61-43ae745ca450 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:46.663967 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500d5e8-e0bf-4336-9e61-43ae745ca450 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:46.666808 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 119/255] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:46 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:46.674021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500d5e8-e0bf-4336-9e61-43ae745ca450 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:46.733122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:46.799479 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 137/256] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:46.846372 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500d5e8-e0bf-4336-9e61-43ae745ca450 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:46.896927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476a7b7-7bf2-4ab1-82e4-7a51b2ab5a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:46.899138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476a7b7-7bf2-4ab1-82e4-7a51b2ab5a19 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:46.899422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476a7b7-7bf2-4ab1-82e4-7a51b2ab5a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:46.899702 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476a7b7-7bf2-4ab1-82e4-7a51b2ab5a19 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf/users/94cc4a345484463ab6855cffd6dbc7a2/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:46.906737 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476a7b7-7bf2-4ab1-82e4-7a51b2ab5a19 None admin] RBAC: Authorizing `identity:create_grant(project_id=97d4b1bf1bff4d36a820888731015eaf, user_id=94cc4a345484463ab6855cffd6dbc7a2, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:46.908193 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476a7b7-7bf2-4ab1-82e4-7a51b2ab5a19 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:46.917099 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95879d8-17d6-4cec-ace8-f55f9d326d73 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:46.984142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 120/257] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:43:46 2022] PUT /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf/users/94cc4a345484463ab6855cffd6dbc7a2/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:47.057080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95879d8-17d6-4cec-ace8-f55f9d326d73 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:47.103938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e934d-abd2-4213-ac15-77bde898de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:47.104586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e934d-abd2-4213-ac15-77bde898de0c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:47.104861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e934d-abd2-4213-ac15-77bde898de0c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:47.105129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e934d-abd2-4213-ac15-77bde898de0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:47.119772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e934d-abd2-4213-ac15-77bde898de0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b56e934d-abd2-4213-ac15-77bde898de0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:47.124604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:47.126492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:47.127613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 138/258] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:43:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:47.134491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476a7b7-7bf2-4ab1-82e4-7a51b2ab5a19 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:47.191314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:47.262221 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476a7b7-7bf2-4ab1-82e4-7a51b2ab5a19 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:47.297991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396477-630b-4f8e-9096-72c82ebf4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:47.298604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396477-630b-4f8e-9096-72c82ebf4759 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:47.298882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396477-630b-4f8e-9096-72c82ebf4759 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:47.299154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396477-630b-4f8e-9096-72c82ebf4759 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:47.299823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6396477-630b-4f8e-9096-72c82ebf4759 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:47.300121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6396477-630b-4f8e-9096-72c82ebf4759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:47.301715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6396477-630b-4f8e-9096-72c82ebf4759 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:47.312785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 121/259] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:47.319161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e934d-abd2-4213-ac15-77bde898de0c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:47.367775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:47.370468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396477-630b-4f8e-9096-72c82ebf4759 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:47.483425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e934d-abd2-4213-ac15-77bde898de0c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:47.493236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396477-630b-4f8e-9096-72c82ebf4759 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:47.501168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:47.533104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d16ab-796d-49be-91b0-f6a7d650f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:47.534111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d16ab-796d-49be-91b0-f6a7d650f09f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:47.534642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d16ab-796d-49be-91b0-f6a7d650f09f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:47.535125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d16ab-796d-49be-91b0-f6a7d650f09f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:47.547425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d16ab-796d-49be-91b0-f6a7d650f09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-894d16ab-796d-49be-91b0-f6a7d650f09f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:47.553359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:47.554432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:43:47.555253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:47.555859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2e089-fe0e-45eb-9423-2f7a8e48b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:47.556463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2e089-fe0e-45eb-9423-2f7a8e48b252 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:47.556628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2e089-fe0e-45eb-9423-2f7a8e48b252 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:47.556895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2e089-fe0e-45eb-9423-2f7a8e48b252 None admin] PATH_INFO: `/v3/users/1e0ca11b90c2456d8ec4e029176b5f84` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:47.562429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2e089-fe0e-45eb-9423-2f7a8e48b252 None admin] RBAC: Authorizing `identity:get_user(user_id=1e0ca11b90c2456d8ec4e029176b5f84)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:47.562762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 122/260] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:47.564214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2e089-fe0e-45eb-9423-2f7a8e48b252 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:47.565318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d16ab-796d-49be-91b0-f6a7d650f09f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:47.566017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 139/261] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:47 2022] GET /identity/v3/users/1e0ca11b90c2456d8ec4e029176b5f84 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:47.572284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2e089-fe0e-45eb-9423-2f7a8e48b252 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:47.678376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d16ab-796d-49be-91b0-f6a7d650f09f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:47.715982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb74a-4de5-4b45-ac90-5620eff2ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:47.716935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb74a-4de5-4b45-ac90-5620eff2ea08 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:47.717415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb74a-4de5-4b45-ac90-5620eff2ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:47.717991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb74a-4de5-4b45-ac90-5620eff2ea08 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:47.718981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eb74a-4de5-4b45-ac90-5620eff2ea08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:47.719482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eb74a-4de5-4b45-ac90-5620eff2ea08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:47.721078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eb74a-4de5-4b45-ac90-5620eff2ea08 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:47.734713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2e089-fe0e-45eb-9423-2f7a8e48b252 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:47.735105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 123/262] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:47.736522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb74a-4de5-4b45-ac90-5620eff2ea08 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:47.738455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:47.769000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:47.788273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9116ae-3cb7-4098-8d81-c8c13725b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:47.788823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9116ae-3cb7-4098-8d81-c8c13725b00b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:47.789170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9116ae-3cb7-4098-8d81-c8c13725b00b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:47.789383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9116ae-3cb7-4098-8d81-c8c13725b00b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:47.851927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb74a-4de5-4b45-ac90-5620eff2ea08 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:47.893211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1379-1867-4f5f-945d-7bcd829a16b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:47.895594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1379-1867-4f5f-945d-7bcd829a16b5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:47.896218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1379-1867-4f5f-945d-7bcd829a16b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:47.897431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1379-1867-4f5f-945d-7bcd829a16b5 None admin] PATH_INFO: `/v3/users/1e0ca11b90c2456d8ec4e029176b5f84` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:47.898543 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9116ae-3cb7-4098-8d81-c8c13725b00b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:47.898773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac1379-1867-4f5f-945d-7bcd829a16b5 None admin] RBAC: Authorizing `identity:get_user(user_id=1e0ca11b90c2456d8ec4e029176b5f84)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:47.900243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac1379-1867-4f5f-945d-7bcd829a16b5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:47.901851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9116ae-3cb7-4098-8d81-c8c13725b00b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:47.905488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 124/263] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:47 2022] GET /identity/v3/users/1e0ca11b90c2456d8ec4e029176b5f84 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:47.911931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1379-1867-4f5f-945d-7bcd829a16b5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:48.058205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 140/264] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:48.065445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9116ae-3cb7-4098-8d81-c8c13725b00b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:48.071670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:48.151052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:48.174096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1379-1867-4f5f-945d-7bcd829a16b5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:48.249990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd1473-6660-492f-8307-f43704675634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:48.250608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd1473-6660-492f-8307-f43704675634 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:48.250943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd1473-6660-492f-8307-f43704675634 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:48.251218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd1473-6660-492f-8307-f43704675634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:48.274652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9116ae-3cb7-4098-8d81-c8c13725b00b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:48.330206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e8776-d36f-4dac-9042-b85946c27dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:48.331165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e8776-d36f-4dac-9042-b85946c27dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:48.331872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e8776-d36f-4dac-9042-b85946c27dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:48.332402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e8776-d36f-4dac-9042-b85946c27dc8 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:48.336081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e8776-d36f-4dac-9042-b85946c27dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:48.337864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e8776-d36f-4dac-9042-b85946c27dc8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:48.339817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 141/265] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:48 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:48.346051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e8776-d36f-4dac-9042-b85946c27dc8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:48.427043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd1473-6660-492f-8307-f43704675634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:48.428597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd1473-6660-492f-8307-f43704675634 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:48.453389 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:48.489807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e8776-d36f-4dac-9042-b85946c27dc8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:48.555098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a510-a645-452a-9d0d-f159e0d46691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:48.555795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a510-a645-452a-9d0d-f159e0d46691 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:48.555993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a510-a645-452a-9d0d-f159e0d46691 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:48.556251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75a510-a645-452a-9d0d-f159e0d46691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:48.556982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75a510-a645-452a-9d0d-f159e0d46691 None admin] RBAC: Adding query filter params (role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=97d4b1bf1bff4d36a820888731015eaf, user.id=1e0ca11b90c2456d8ec4e029176b5f84) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:48.557282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75a510-a645-452a-9d0d-f159e0d46691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:48.558754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75a510-a645-452a-9d0d-f159e0d46691 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:48.575456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 142/266] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:48 2022] GET /identity/v3/role_assignments?user.id=1e0ca11b90c2456d8ec4e029176b5f84&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:48.641848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:48.649486 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 125/267] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:48.656377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a510-a645-452a-9d0d-f159e0d46691 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:48.768883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a59f27-c3f7-4357-80ee-12b6edca4ba5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:48.769490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a59f27-c3f7-4357-80ee-12b6edca4ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:48.770188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a59f27-c3f7-4357-80ee-12b6edca4ba5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:48.773438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 126/268] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:48.778136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c8199-e775-4c98-8826-91babbd51e97 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:48.778416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c8199-e775-4c98-8826-91babbd51e97 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:48.778683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c8199-e775-4c98-8826-91babbd51e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:48.804410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-856c8199-e775-4c98-8826-91babbd51e97 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:48.811894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-856c8199-e775-4c98-8826-91babbd51e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:48.832092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75a510-a645-452a-9d0d-f159e0d46691 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:48.896900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069910d-f824-4f92-91f4-010db0d2d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:48.897451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069910d-f824-4f92-91f4-010db0d2d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:48.897746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069910d-f824-4f92-91f4-010db0d2d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:48.898014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069910d-f824-4f92-91f4-010db0d2d6d9 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:48.899854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069910d-f824-4f92-91f4-010db0d2d6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:48.901270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069910d-f824-4f92-91f4-010db0d2d6d9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:48.906460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 143/269] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:48 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:48.911139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069910d-f824-4f92-91f4-010db0d2d6d9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:48.916798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:48.932983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 127/270] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:49.038869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069910d-f824-4f92-91f4-010db0d2d6d9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:49.079426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822ded0-85e8-4932-bf58-2dad723380b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:49.080032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822ded0-85e8-4932-bf58-2dad723380b5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:49.080304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822ded0-85e8-4932-bf58-2dad723380b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:49.080573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822ded0-85e8-4932-bf58-2dad723380b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:49.081290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822ded0-85e8-4932-bf58-2dad723380b5 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=97d4b1bf1bff4d36a820888731015eaf, user.id=1e0ca11b90c2456d8ec4e029176b5f84) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:49.081616 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822ded0-85e8-4932-bf58-2dad723380b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:49.083559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822ded0-85e8-4932-bf58-2dad723380b5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:49.094287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 144/271] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:48 2022] GET /identity/v3/role_assignments?user.id=1e0ca11b90c2456d8ec4e029176b5f84&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:49.254729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88781c2e-ab5b-4bea-8426-2d7810312794 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:49.254946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88781c2e-ab5b-4bea-8426-2d7810312794 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:49.255213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88781c2e-ab5b-4bea-8426-2d7810312794 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:49.256935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 128/272] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:49.262554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975033-2351-43e5-bf20-944e996d2fa1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:49.262833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975033-2351-43e5-bf20-944e996d2fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:49.263104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975033-2351-43e5-bf20-944e996d2fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:49.282373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a9975033-2351-43e5-bf20-944e996d2fa1 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:49.283579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a9975033-2351-43e5-bf20-944e996d2fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:49.290531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88781c2e-ab5b-4bea-8426-2d7810312794 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:49.395906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:49.402082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 145/273] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:49.403681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196333-49ad-44eb-829e-b59f04a321d6 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:49.404134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196333-49ad-44eb-829e-b59f04a321d6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:49.404693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196333-49ad-44eb-829e-b59f04a321d6 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:49.406472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 146/274] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:49.414177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294ea3-ce87-40d5-bde5-817087d77e59 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:49.414730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294ea3-ce87-40d5-bde5-817087d77e59 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:49.415125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294ea3-ce87-40d5-bde5-817087d77e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:49.422763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88781c2e-ab5b-4bea-8426-2d7810312794 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:49.439512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7b294ea3-ce87-40d5-bde5-817087d77e59 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:49.442074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7b294ea3-ce87-40d5-bde5-817087d77e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:49.456862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:49.471384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb7b91-0bb9-466a-8fda-4217e2c2ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:49.472385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb7b91-0bb9-466a-8fda-4217e2c2ef93 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:49.473746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb7b91-0bb9-466a-8fda-4217e2c2ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:49.474633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb7b91-0bb9-466a-8fda-4217e2c2ef93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:49.476077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb7b91-0bb9-466a-8fda-4217e2c2ef93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:49.478254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb7b91-0bb9-466a-8fda-4217e2c2ef93 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:49.480718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 129/275] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:49.486401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb7b91-0bb9-466a-8fda-4217e2c2ef93 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:49.530928 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 147/276] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:49.604160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb7b91-0bb9-466a-8fda-4217e2c2ef93 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:49.639911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be185a-0bd1-42ea-9c2c-00debedcdd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:49.640509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be185a-0bd1-42ea-9c2c-00debedcdd92 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:49.640779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be185a-0bd1-42ea-9c2c-00debedcdd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:49.641042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be185a-0bd1-42ea-9c2c-00debedcdd92 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:49.641700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be185a-0bd1-42ea-9c2c-00debedcdd92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:49.643118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be185a-0bd1-42ea-9c2c-00debedcdd92 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:49.691116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b294ea3-ce87-40d5-bde5-817087d77e59 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:49.741652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 130/277] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:43:49 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:43:49.807967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b294ea3-ce87-40d5-bde5-817087d77e59 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:49.840709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:49.840982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be185a-0bd1-42ea-9c2c-00debedcdd92 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:49.850081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92c308-b517-4369-9c8f-0638d9ed2f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:49.851020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c308-b517-4369-9c8f-0638d9ed2f2d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:49.851489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c308-b517-4369-9c8f-0638d9ed2f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:49.852970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c308-b517-4369-9c8f-0638d9ed2f2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:49.865424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92c308-b517-4369-9c8f-0638d9ed2f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1e92c308-b517-4369-9c8f-0638d9ed2f2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:49.871905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:49.873072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:49.874102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:49.876707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 148/278] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:49.882509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92c308-b517-4369-9c8f-0638d9ed2f2d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:49.914309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:49.973783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be185a-0bd1-42ea-9c2c-00debedcdd92 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:50.001209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92c308-b517-4369-9c8f-0638d9ed2f2d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:50.014436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6066f3-b4a5-43b2-9121-f041caf49594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:50.015331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6066f3-b4a5-43b2-9121-f041caf49594 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.015612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6066f3-b4a5-43b2-9121-f041caf49594 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.015881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6066f3-b4a5-43b2-9121-f041caf49594 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.031099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6066f3-b4a5-43b2-9121-f041caf49594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ca6066f3-b4a5-43b2-9121-f041caf49594 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:50.036621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:50.037833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:50.038636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:50.039231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 131/279] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:50.043455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8211e74-a64f-4f41-b1be-b1d64493ae81 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.043455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8211e74-a64f-4f41-b1be-b1d64493ae81 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.043455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8211e74-a64f-4f41-b1be-b1d64493ae81 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.043759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01764fc5-6bc0-43a0-bd87-f9a0d740e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:50.044564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764fc5-6bc0-43a0-bd87-f9a0d740e98d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.044660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 132/280] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:50.044728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764fc5-6bc0-43a0-bd87-f9a0d740e98d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.045643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764fc5-6bc0-43a0-bd87-f9a0d740e98d None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.045824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01764fc5-6bc0-43a0-bd87-f9a0d740e98d None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:50.048208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01764fc5-6bc0-43a0-bd87-f9a0d740e98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:50.048208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01764fc5-6bc0-43a0-bd87-f9a0d740e98d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:50.048520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8211e74-a64f-4f41-b1be-b1d64493ae81 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:50.058124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 149/281] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:50.059483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12aa9fe-2d6b-473d-83d7-0c7dff022de9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.059770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12aa9fe-2d6b-473d-83d7-0c7dff022de9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.060041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12aa9fe-2d6b-473d-83d7-0c7dff022de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.080015 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b12aa9fe-2d6b-473d-83d7-0c7dff022de9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:50.081197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b12aa9fe-2d6b-473d-83d7-0c7dff022de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:50.144276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:50.168879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 150/282] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:50.169636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12aa9fe-2d6b-473d-83d7-0c7dff022de9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:50.173113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8211e74-a64f-4f41-b1be-b1d64493ae81 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:50.183828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:50.208668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9652f-c28d-402c-8c5e-e69b793bdc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:50.209280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9652f-c28d-402c-8c5e-e69b793bdc56 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.209592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9652f-c28d-402c-8c5e-e69b793bdc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.209860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9652f-c28d-402c-8c5e-e69b793bdc56 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.210531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9652f-c28d-402c-8c5e-e69b793bdc56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:50.210831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9652f-c28d-402c-8c5e-e69b793bdc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:50.212330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9652f-c28d-402c-8c5e-e69b793bdc56 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:50.221641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 133/283] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:50.234525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9652f-c28d-402c-8c5e-e69b793bdc56 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:50.285894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12aa9fe-2d6b-473d-83d7-0c7dff022de9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:50.323207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda508d-b873-4214-8d59-443e15092519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:50.323768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda508d-b873-4214-8d59-443e15092519 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.324046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda508d-b873-4214-8d59-443e15092519 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.324318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda508d-b873-4214-8d59-443e15092519 None admin] PATH_INFO: `/v3/users/74e4bc53122b40039a2ebcedb515f63e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.339698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda508d-b873-4214-8d59-443e15092519 None admin] RBAC: Authorizing `identity:get_user(user_id=74e4bc53122b40039a2ebcedb515f63e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:50.341326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda508d-b873-4214-8d59-443e15092519 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:50.343159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 151/284] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:50 2022] GET /identity/v3/users/74e4bc53122b40039a2ebcedb515f63e => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:50.349188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda508d-b873-4214-8d59-443e15092519 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:50.396694 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:50.431189 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9652f-c28d-402c-8c5e-e69b793bdc56 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:50.458243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda508d-b873-4214-8d59-443e15092519 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:50.494879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7620-7499-46b9-894f-2308b9a6a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:50.495496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7620-7499-46b9-894f-2308b9a6a64b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.495781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7620-7499-46b9-894f-2308b9a6a64b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.496060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7620-7499-46b9-894f-2308b9a6a64b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.496805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7620-7499-46b9-894f-2308b9a6a64b None admin] RBAC: Adding query filter params (role.id=a9232505007a45c580ef9414aee94847, user.id=74e4bc53122b40039a2ebcedb515f63e, scope.system=all) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:50.497114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7620-7499-46b9-894f-2308b9a6a64b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:50.498596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7620-7499-46b9-894f-2308b9a6a64b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:50.505061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 152/285] 10.222.0.58 () {56 vars in 1308 bytes} [Wed Aug 24 07:43:50 2022] GET /identity/v3/role_assignments?user.id=74e4bc53122b40039a2ebcedb515f63e&scope.system=all&role.id=a9232505007a45c580ef9414aee94847 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:50.528556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1dd43-ed54-44a0-83fd-dc33efd1d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:50.529272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1dd43-ed54-44a0-83fd-dc33efd1d4cc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.529588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1dd43-ed54-44a0-83fd-dc33efd1d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.529862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1dd43-ed54-44a0-83fd-dc33efd1d4cc None admin] PATH_INFO: `/v3/users/0542c1d5d05844aaadcae31b4723ee7b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.534367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1dd43-ed54-44a0-83fd-dc33efd1d4cc None admin] RBAC: Authorizing `identity:get_user(user_id=0542c1d5d05844aaadcae31b4723ee7b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:50.536185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1dd43-ed54-44a0-83fd-dc33efd1d4cc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:50.538217 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 134/286] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:50 2022] GET /identity/v3/users/0542c1d5d05844aaadcae31b4723ee7b => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:50.544118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7620-7499-46b9-894f-2308b9a6a64b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:50.556426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1dd43-ed54-44a0-83fd-dc33efd1d4cc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:50.650322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:50.707426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7620-7499-46b9-894f-2308b9a6a64b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:50.709590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:50.730149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1dd43-ed54-44a0-83fd-dc33efd1d4cc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:50.767688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4940e-bcb1-4017-b78b-68e62fd4e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:50.768778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4940e-bcb1-4017-b78b-68e62fd4e009 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.769336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4940e-bcb1-4017-b78b-68e62fd4e009 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.769884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4940e-bcb1-4017-b78b-68e62fd4e009 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.780640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4940e-bcb1-4017-b78b-68e62fd4e009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-75c4940e-bcb1-4017-b78b-68e62fd4e009 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:50.786509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:50.787387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:50.788430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:50.791106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 135/287] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:50.796267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4940e-bcb1-4017-b78b-68e62fd4e009 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:50.802737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0c71f-3db3-4dcb-afe0-8493bc78ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:50.803387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0c71f-3db3-4dcb-afe0-8493bc78ae91 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.803666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0c71f-3db3-4dcb-afe0-8493bc78ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.803937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0c71f-3db3-4dcb-afe0-8493bc78ae91 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.810149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0c71f-3db3-4dcb-afe0-8493bc78ae91 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:50.811600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0c71f-3db3-4dcb-afe0-8493bc78ae91 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:50.813424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 153/288] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:50 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:50.819773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0c71f-3db3-4dcb-afe0-8493bc78ae91 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:50.903649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4940e-bcb1-4017-b78b-68e62fd4e009 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:50.906174 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:50.942943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bec716-839d-4f2c-ad6e-85ef98cffab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:50.946894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bec716-839d-4f2c-ad6e-85ef98cffab7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:50.946894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bec716-839d-4f2c-ad6e-85ef98cffab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:50.946894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bec716-839d-4f2c-ad6e-85ef98cffab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:50.946894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bec716-839d-4f2c-ad6e-85ef98cffab7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:50.946894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bec716-839d-4f2c-ad6e-85ef98cffab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:50.946894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bec716-839d-4f2c-ad6e-85ef98cffab7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:50.957831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 136/289] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:50.966535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bec716-839d-4f2c-ad6e-85ef98cffab7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:51.012662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0c71f-3db3-4dcb-afe0-8493bc78ae91 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:51.080609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6b1b1-c3a7-4389-a4a0-87dc6dab16ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:51.082410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6b1b1-c3a7-4389-a4a0-87dc6dab16ea None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:51.082914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6b1b1-c3a7-4389-a4a0-87dc6dab16ea None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:51.083185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6b1b1-c3a7-4389-a4a0-87dc6dab16ea None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf/users/0542c1d5d05844aaadcae31b4723ee7b/roles/1028072c80a14a309ff74e79948a9b25` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:51.086609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6b1b1-c3a7-4389-a4a0-87dc6dab16ea None admin] RBAC: Authorizing `identity:create_grant(project_id=97d4b1bf1bff4d36a820888731015eaf, user_id=0542c1d5d05844aaadcae31b4723ee7b, role_id=1028072c80a14a309ff74e79948a9b25)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:51.088068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6b1b1-c3a7-4389-a4a0-87dc6dab16ea None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:51.122562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bec716-839d-4f2c-ad6e-85ef98cffab7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:51.158498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdc7b3-4bec-4abc-871e-ae4d03f295e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:51.159516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdc7b3-4bec-4abc-871e-ae4d03f295e7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:51.159995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdc7b3-4bec-4abc-871e-ae4d03f295e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:51.161022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdc7b3-4bec-4abc-871e-ae4d03f295e7 None admin] PATH_INFO: `/v3/users/94cc4a345484463ab6855cffd6dbc7a2` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:51.162806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdc7b3-4bec-4abc-871e-ae4d03f295e7 None admin] RBAC: Authorizing `identity:get_user(user_id=94cc4a345484463ab6855cffd6dbc7a2)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:51.164596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdc7b3-4bec-4abc-871e-ae4d03f295e7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:51.166851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 137/290] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:50 2022] GET /identity/v3/users/94cc4a345484463ab6855cffd6dbc7a2 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:51.172661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdc7b3-4bec-4abc-871e-ae4d03f295e7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:51.206884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:51.208024 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 154/291] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:43:50 2022] PUT /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf/users/0542c1d5d05844aaadcae31b4723ee7b/roles/1028072c80a14a309ff74e79948a9b25 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:51.289872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdc7b3-4bec-4abc-871e-ae4d03f295e7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:51.333636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070199b-c494-409b-815d-cc624e370189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:51.334575 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070199b-c494-409b-815d-cc624e370189 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:51.335087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070199b-c494-409b-815d-cc624e370189 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:51.335552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070199b-c494-409b-815d-cc624e370189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:51.415080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070199b-c494-409b-815d-cc624e370189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:51.416631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070199b-c494-409b-815d-cc624e370189 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:51.453844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:51.524849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 138/292] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:51.530662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6b1b1-c3a7-4389-a4a0-87dc6dab16ea None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:51.568089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:51.646998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6b1b1-c3a7-4389-a4a0-87dc6dab16ea None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:51.692220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a82fed-48e3-4ee1-948b-22c39785516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:51.692787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a82fed-48e3-4ee1-948b-22c39785516a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:51.693065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a82fed-48e3-4ee1-948b-22c39785516a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:51.693343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a82fed-48e3-4ee1-948b-22c39785516a None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:51.694748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a82fed-48e3-4ee1-948b-22c39785516a None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:51.696189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a82fed-48e3-4ee1-948b-22c39785516a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:51.698117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 155/293] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:51 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:51.706918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070199b-c494-409b-815d-cc624e370189 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:51.856370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070199b-c494-409b-815d-cc624e370189 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:51.896090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:51.901972 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f077fa-12fe-47f0-b58a-279381a315d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:51.902584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f077fa-12fe-47f0-b58a-279381a315d1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:51.902864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f077fa-12fe-47f0-b58a-279381a315d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:51.903134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f077fa-12fe-47f0-b58a-279381a315d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:51.903873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f077fa-12fe-47f0-b58a-279381a315d1 None admin] RBAC: Adding query filter params (role.id=a9232505007a45c580ef9414aee94847, scope.project.id=97d4b1bf1bff4d36a820888731015eaf, user.id=94cc4a345484463ab6855cffd6dbc7a2) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:51.904179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f077fa-12fe-47f0-b58a-279381a315d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:51.905641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f077fa-12fe-47f0-b58a-279381a315d1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:51.913540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 139/294] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:51 2022] GET /identity/v3/role_assignments?user.id=94cc4a345484463ab6855cffd6dbc7a2&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=a9232505007a45c580ef9414aee94847 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:52.147297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e97c-277c-4f7a-a06a-3d3760628ac8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.147661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e97c-277c-4f7a-a06a-3d3760628ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.147854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e97c-277c-4f7a-a06a-3d3760628ac8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.149390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 156/295] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:52.156065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49329-7870-49c7-85c5-a194e9560260 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.156357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49329-7870-49c7-85c5-a194e9560260 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.156632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49329-7870-49c7-85c5-a194e9560260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.177899 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-79f49329-7870-49c7-85c5-a194e9560260 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:52.179373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-79f49329-7870-49c7-85c5-a194e9560260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:52.248791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3e44c-530e-4d30-8b70-cf955ee73f2f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.249100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3e44c-530e-4d30-8b70-cf955ee73f2f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.249344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3e44c-530e-4d30-8b70-cf955ee73f2f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.250989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 157/296] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:52.257581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 140/297] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:52.262768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596979e-34e8-45fb-b2a8-1a7a8a013ecd None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.263298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596979e-34e8-45fb-b2a8-1a7a8a013ecd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.263567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596979e-34e8-45fb-b2a8-1a7a8a013ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.286225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a596979e-34e8-45fb-b2a8-1a7a8a013ecd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:52.287656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a596979e-34e8-45fb-b2a8-1a7a8a013ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:52.379542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 158/298] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:52.556209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f49329-7870-49c7-85c5-a194e9560260 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:52.659131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f49329-7870-49c7-85c5-a194e9560260 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:52.668821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596979e-34e8-45fb-b2a8-1a7a8a013ecd None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:52.686768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:52.699306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ca50c-8f33-4d1b-a66e-010a614514e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:52.700302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ca50c-8f33-4d1b-a66e-010a614514e8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.700846 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ca50c-8f33-4d1b-a66e-010a614514e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.701275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ca50c-8f33-4d1b-a66e-010a614514e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.701831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:52.713236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ca50c-8f33-4d1b-a66e-010a614514e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d66ca50c-8f33-4d1b-a66e-010a614514e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:52.718710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:52.719563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:52.720369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:52.723510 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 141/299] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:52.729959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ca50c-8f33-4d1b-a66e-010a614514e8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:52.792482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596979e-34e8-45fb-b2a8-1a7a8a013ecd None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:52.828532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc5b42-6db1-430a-8807-755ef1ab0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:52.829506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc5b42-6db1-430a-8807-755ef1ab0de1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.829979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc5b42-6db1-430a-8807-755ef1ab0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.830436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc5b42-6db1-430a-8807-755ef1ab0de1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.831721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc5b42-6db1-430a-8807-755ef1ab0de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:52.833927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc5b42-6db1-430a-8807-755ef1ab0de1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:52.835777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 159/300] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:52.841350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc5b42-6db1-430a-8807-755ef1ab0de1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:52.866992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ca50c-8f33-4d1b-a66e-010a614514e8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:52.918547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae378b5-a479-490f-83d5-1e325238c3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:52.919148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae378b5-a479-490f-83d5-1e325238c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.919421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae378b5-a479-490f-83d5-1e325238c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.919687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae378b5-a479-490f-83d5-1e325238c3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.920340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae378b5-a479-490f-83d5-1e325238c3f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:52.920637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae378b5-a479-490f-83d5-1e325238c3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:52.922041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae378b5-a479-490f-83d5-1e325238c3f5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:52.933647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 142/301] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:52.933647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bcaff-eab2-49b5-87d1-7416ace43c78 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.933647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bcaff-eab2-49b5-87d1-7416ace43c78 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.933647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bcaff-eab2-49b5-87d1-7416ace43c78 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.933993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 143/302] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:52.938985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a60a4-e6c0-464a-8aee-14588353cde0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.939266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a60a4-e6c0-464a-8aee-14588353cde0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.939531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a60a4-e6c0-464a-8aee-14588353cde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.946280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:52.953766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc5b42-6db1-430a-8807-755ef1ab0de1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:52.959535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0a5a60a4-e6c0-464a-8aee-14588353cde0 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:52.959535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0a5a60a4-e6c0-464a-8aee-14588353cde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:52.993962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad014f2-6dd3-4b7d-98c7-bf0fb9677f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:52.994580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad014f2-6dd3-4b7d-98c7-bf0fb9677f27 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:52.994856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad014f2-6dd3-4b7d-98c7-bf0fb9677f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:52.995127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad014f2-6dd3-4b7d-98c7-bf0fb9677f27 None admin] PATH_INFO: `/v3/groups` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:52.995756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad014f2-6dd3-4b7d-98c7-bf0fb9677f27 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:52.997190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad014f2-6dd3-4b7d-98c7-bf0fb9677f27 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:53.002225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:53.027013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 144/303] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:53.028915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a60a4-e6c0-464a-8aee-14588353cde0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:53.079010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 160/304] 10.222.0.58 () {60 vars in 1134 bytes} [Wed Aug 24 07:43:52 2022] POST /identity/v3/groups => generated 229 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:43:53.162104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a60a4-e6c0-464a-8aee-14588353cde0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:53.201820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654ee6-3daf-4f97-8fb1-15776c2d0ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:53.202825 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654ee6-3daf-4f97-8fb1-15776c2d0ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.203363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654ee6-3daf-4f97-8fb1-15776c2d0ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.203825 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f654ee6-3daf-4f97-8fb1-15776c2d0ea5 None admin] PATH_INFO: `/v3/users/e280661ff9664c9c86bc57e196f4b394` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.220492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f654ee6-3daf-4f97-8fb1-15776c2d0ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=e280661ff9664c9c86bc57e196f4b394)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:53.222334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f654ee6-3daf-4f97-8fb1-15776c2d0ea5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:53.224660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 145/305] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:53 2022] GET /identity/v3/users/e280661ff9664c9c86bc57e196f4b394 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:53.231194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad014f2-6dd3-4b7d-98c7-bf0fb9677f27 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:53.311894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654ee6-3daf-4f97-8fb1-15776c2d0ea5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:53.353752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad014f2-6dd3-4b7d-98c7-bf0fb9677f27 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:53.357479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:53.397811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfb919-b745-40b6-b406-a1aa46547c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:53.399079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfb919-b745-40b6-b406-a1aa46547c25 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.400563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfb919-b745-40b6-b406-a1aa46547c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.401030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfb919-b745-40b6-b406-a1aa46547c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.402116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfb919-b745-40b6-b406-a1aa46547c25 None admin] RBAC: Adding query filter params (role.id=1028072c80a14a309ff74e79948a9b25, user.id=e280661ff9664c9c86bc57e196f4b394, scope.system=all) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:53.402657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfb919-b745-40b6-b406-a1aa46547c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:53.404671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfb919-b745-40b6-b406-a1aa46547c25 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:53.412264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 161/306] 10.222.0.58 () {56 vars in 1308 bytes} [Wed Aug 24 07:43:53 2022] GET /identity/v3/role_assignments?user.id=e280661ff9664c9c86bc57e196f4b394&scope.system=all&role.id=1028072c80a14a309ff74e79948a9b25 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:53.446605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f654ee6-3daf-4f97-8fb1-15776c2d0ea5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:53.485350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28576a0-fceb-465c-96f7-2f138ee8ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:53.486031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28576a0-fceb-465c-96f7-2f138ee8ae83 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.486307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28576a0-fceb-465c-96f7-2f138ee8ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.486576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28576a0-fceb-465c-96f7-2f138ee8ae83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.499475 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28576a0-fceb-465c-96f7-2f138ee8ae83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-e28576a0-fceb-465c-96f7-2f138ee8ae83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:53.504332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:53.505242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:53.506101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 146/307] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:53.512835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfb919-b745-40b6-b406-a1aa46547c25 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:53.541620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:53.552277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed57d-1839-4ca8-8ea4-b1f9dc812c2b None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.552710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed57d-1839-4ca8-8ea4-b1f9dc812c2b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.556847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed57d-1839-4ca8-8ea4-b1f9dc812c2b None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.556847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 147/308] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:53.560876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c258e24-0e6f-49cd-89dc-e771c15dc6dc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.561152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c258e24-0e6f-49cd-89dc-e771c15dc6dc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.561417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c258e24-0e6f-49cd-89dc-e771c15dc6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.580031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9c258e24-0e6f-49cd-89dc-e771c15dc6dc None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:53.581331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9c258e24-0e6f-49cd-89dc-e771c15dc6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:53.645421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfb919-b745-40b6-b406-a1aa46547c25 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:53.664800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 148/309] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:53.680568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e0278-eeff-4546-bec9-67717dc257d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:53.681179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e0278-eeff-4546-bec9-67717dc257d3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.681440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e0278-eeff-4546-bec9-67717dc257d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.681749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e0278-eeff-4546-bec9-67717dc257d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.683056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e0278-eeff-4546-bec9-67717dc257d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:53.683056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e0278-eeff-4546-bec9-67717dc257d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:53.685549 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e0278-eeff-4546-bec9-67717dc257d3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:53.693623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 162/310] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:53.699120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c258e24-0e6f-49cd-89dc-e771c15dc6dc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:53.734839 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:53.805048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c258e24-0e6f-49cd-89dc-e771c15dc6dc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:53.840204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955a91f-c62c-4a6e-8d0b-da3ee8b440b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:53.840841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955a91f-c62c-4a6e-8d0b-da3ee8b440b6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.841121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955a91f-c62c-4a6e-8d0b-da3ee8b440b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.841396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955a91f-c62c-4a6e-8d0b-da3ee8b440b6 None admin] PATH_INFO: `/v3/users/74e4bc53122b40039a2ebcedb515f63e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.842556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955a91f-c62c-4a6e-8d0b-da3ee8b440b6 None admin] RBAC: Authorizing `identity:get_user(user_id=74e4bc53122b40039a2ebcedb515f63e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:53.844007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955a91f-c62c-4a6e-8d0b-da3ee8b440b6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:53.845605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 149/311] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:53 2022] GET /identity/v3/users/74e4bc53122b40039a2ebcedb515f63e => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:53.851520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e0278-eeff-4546-bec9-67717dc257d3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:53.941943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:53.959649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e0278-eeff-4546-bec9-67717dc257d3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:53.969814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955a91f-c62c-4a6e-8d0b-da3ee8b440b6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:53.995280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae715c-5227-492d-9342-f59a4099e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:53.995929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae715c-5227-492d-9342-f59a4099e568 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:53.996199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae715c-5227-492d-9342-f59a4099e568 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:53.996465 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae715c-5227-492d-9342-f59a4099e568 None admin] PATH_INFO: `/v3/system/users/74e4bc53122b40039a2ebcedb515f63e/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:53.998019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae715c-5227-492d-9342-f59a4099e568 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74e4bc53122b40039a2ebcedb515f63e, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:53.999528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae715c-5227-492d-9342-f59a4099e568 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:54.068927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:54.078172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955a91f-c62c-4a6e-8d0b-da3ee8b440b6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:54.098521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 163/312] 10.222.0.58 () {58 vars in 1334 bytes} [Wed Aug 24 07:43:53 2022] PUT /identity/v3/system/users/74e4bc53122b40039a2ebcedb515f63e/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:43:54.116652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dda118-8ed9-44a1-bf5f-9f721b7011d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:54.117834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dda118-8ed9-44a1-bf5f-9f721b7011d3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:54.118306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dda118-8ed9-44a1-bf5f-9f721b7011d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:54.118831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dda118-8ed9-44a1-bf5f-9f721b7011d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:54.133966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dda118-8ed9-44a1-bf5f-9f721b7011d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a8dda118-8ed9-44a1-bf5f-9f721b7011d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:54.139664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:54.140588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:54.141399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:54.145139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 150/313] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:54.151102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae715c-5227-492d-9342-f59a4099e568 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:54.264650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae715c-5227-492d-9342-f59a4099e568 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:54.303005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647cee8-d85e-4a74-8abc-07ab7f1b326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:54.304051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647cee8-d85e-4a74-8abc-07ab7f1b326a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:54.304568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647cee8-d85e-4a74-8abc-07ab7f1b326a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:54.305041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647cee8-d85e-4a74-8abc-07ab7f1b326a None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:54.305946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647cee8-d85e-4a74-8abc-07ab7f1b326a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:54.306453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647cee8-d85e-4a74-8abc-07ab7f1b326a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:54.308125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647cee8-d85e-4a74-8abc-07ab7f1b326a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:54.317635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 164/314] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:54.326575 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dda118-8ed9-44a1-bf5f-9f721b7011d3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:54.440513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dda118-8ed9-44a1-bf5f-9f721b7011d3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:54.475780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31c5c7-47dc-4856-adb0-7e5a23165810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:54.476564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31c5c7-47dc-4856-adb0-7e5a23165810 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:54.476931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31c5c7-47dc-4856-adb0-7e5a23165810 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:54.477296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31c5c7-47dc-4856-adb0-7e5a23165810 None admin] PATH_INFO: `/v3/users/0542c1d5d05844aaadcae31b4723ee7b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:54.478600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31c5c7-47dc-4856-adb0-7e5a23165810 None admin] RBAC: Authorizing `identity:get_user(user_id=0542c1d5d05844aaadcae31b4723ee7b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:54.480131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31c5c7-47dc-4856-adb0-7e5a23165810 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:54.482136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 151/315] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:54 2022] GET /identity/v3/users/0542c1d5d05844aaadcae31b4723ee7b => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:54.487828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647cee8-d85e-4a74-8abc-07ab7f1b326a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:54.500697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:54.596341 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647cee8-d85e-4a74-8abc-07ab7f1b326a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:54.631817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cb58-dd85-4e06-b9ea-fe8fd5ac1a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:54.632427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cb58-dd85-4e06-b9ea-fe8fd5ac1a53 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:54.632751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cb58-dd85-4e06-b9ea-fe8fd5ac1a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:54.633024 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cb58-dd85-4e06-b9ea-fe8fd5ac1a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:54.708114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cb58-dd85-4e06-b9ea-fe8fd5ac1a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:54.709627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cb58-dd85-4e06-b9ea-fe8fd5ac1a53 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:54.719383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:54.814480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 165/316] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:54.820569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31c5c7-47dc-4856-adb0-7e5a23165810 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:54.843725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:54.931075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31c5c7-47dc-4856-adb0-7e5a23165810 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:54.966608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28653ced-2788-4f52-a92c-2389abb1e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:54.967503 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28653ced-2788-4f52-a92c-2389abb1e7db None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:54.967976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28653ced-2788-4f52-a92c-2389abb1e7db None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:54.968389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28653ced-2788-4f52-a92c-2389abb1e7db None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:54.969711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28653ced-2788-4f52-a92c-2389abb1e7db None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:54.971300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28653ced-2788-4f52-a92c-2389abb1e7db None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:54.974087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 152/317] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:54 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:54.979587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cb58-dd85-4e06-b9ea-fe8fd5ac1a53 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:55.085074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cb58-dd85-4e06-b9ea-fe8fd5ac1a53 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:55.094541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:55.120988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eab23-3907-4761-ab63-8dcf004db427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:55.121641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eab23-3907-4761-ab63-8dcf004db427 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.121916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eab23-3907-4761-ab63-8dcf004db427 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.122213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eab23-3907-4761-ab63-8dcf004db427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.122975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249eab23-3907-4761-ab63-8dcf004db427 None admin] RBAC: Adding query filter params (role.id=1028072c80a14a309ff74e79948a9b25, scope.project.id=97d4b1bf1bff4d36a820888731015eaf, user.id=0542c1d5d05844aaadcae31b4723ee7b) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:55.123247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249eab23-3907-4761-ab63-8dcf004db427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:55.124748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249eab23-3907-4761-ab63-8dcf004db427 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:55.131617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 166/318] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:43:54 2022] GET /identity/v3/role_assignments?user.id=0542c1d5d05844aaadcae31b4723ee7b&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=1028072c80a14a309ff74e79948a9b25 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:55.278218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74d611-d292-4389-aa46-cfdc36fba8ae None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.278505 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74d611-d292-4389-aa46-cfdc36fba8ae None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.278686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74d611-d292-4389-aa46-cfdc36fba8ae None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.280037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 153/319] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:55.285668 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6617535-b722-403e-9b3c-ba6de8ab034a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.285958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6617535-b722-403e-9b3c-ba6de8ab034a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.286361 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6617535-b722-403e-9b3c-ba6de8ab034a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.307006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e6617535-b722-403e-9b3c-ba6de8ab034a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:55.308246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e6617535-b722-403e-9b3c-ba6de8ab034a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:55.360032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1041-432e-4193-b859-796937f3ffeb None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.360319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1041-432e-4193-b859-796937f3ffeb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.360595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1041-432e-4193-b859-796937f3ffeb None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.362032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 154/320] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:55.370763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a89d1-4e8f-49ca-b5c7-6eae8f85e4c1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.371115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a89d1-4e8f-49ca-b5c7-6eae8f85e4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.371475 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a89d1-4e8f-49ca-b5c7-6eae8f85e4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.389939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 167/321] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:55.392971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3a3a89d1-4e8f-49ca-b5c7-6eae8f85e4c1 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:55.394213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3a3a89d1-4e8f-49ca-b5c7-6eae8f85e4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:55.467469 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 155/322] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:55.662718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6617535-b722-403e-9b3c-ba6de8ab034a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:55.747319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a89d1-4e8f-49ca-b5c7-6eae8f85e4c1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:55.764116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6617535-b722-403e-9b3c-ba6de8ab034a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:55.765681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:55.766122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:55.801236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f636791-f72b-4c78-a159-2667f666409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:55.802115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636791-f72b-4c78-a159-2667f666409f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.802755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636791-f72b-4c78-a159-2667f666409f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.803059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636791-f72b-4c78-a159-2667f666409f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.804409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f636791-f72b-4c78-a159-2667f666409f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:55.805924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f636791-f72b-4c78-a159-2667f666409f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:55.807679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 168/323] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:55.812830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f636791-f72b-4c78-a159-2667f666409f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:55.851490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a89d1-4e8f-49ca-b5c7-6eae8f85e4c1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:55.885986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8da1b-a433-49bb-a0c8-e0d3cdf8bcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:55.886624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8da1b-a433-49bb-a0c8-e0d3cdf8bcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.886894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8da1b-a433-49bb-a0c8-e0d3cdf8bcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.887161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8da1b-a433-49bb-a0c8-e0d3cdf8bcc3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.898615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8da1b-a433-49bb-a0c8-e0d3cdf8bcc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0ed8da1b-a433-49bb-a0c8-e0d3cdf8bcc3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:55.904153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:55.905076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:55.905946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 156/324] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:55.913694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8da1b-a433-49bb-a0c8-e0d3cdf8bcc3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:55.927734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f636791-f72b-4c78-a159-2667f666409f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:55.964343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5bf99-b794-4c81-ba64-40fb7d4f9cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:55.965064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5bf99-b794-4c81-ba64-40fb7d4f9cf3 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:55.965344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5bf99-b794-4c81-ba64-40fb7d4f9cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:55.965754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5bf99-b794-4c81-ba64-40fb7d4f9cf3 None admin] PATH_INFO: `/v3/groups` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:55.966375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5bf99-b794-4c81-ba64-40fb7d4f9cf3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:55.967906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5bf99-b794-4c81-ba64-40fb7d4f9cf3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:55.994543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.015750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8da1b-a433-49bb-a0c8-e0d3cdf8bcc3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.050037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d552b1e-0492-4b8b-bf1e-a38b2d8494ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.050663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d552b1e-0492-4b8b-bf1e-a38b2d8494ef None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.050941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d552b1e-0492-4b8b-bf1e-a38b2d8494ef None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.051212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d552b1e-0492-4b8b-bf1e-a38b2d8494ef None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.051871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d552b1e-0492-4b8b-bf1e-a38b2d8494ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:56.052176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d552b1e-0492-4b8b-bf1e-a38b2d8494ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.053581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d552b1e-0492-4b8b-bf1e-a38b2d8494ef None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.061501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 157/325] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:56.067145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d552b1e-0492-4b8b-bf1e-a38b2d8494ef None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.092927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 169/326] 10.222.0.58 () {60 vars in 1134 bytes} [Wed Aug 24 07:43:55 2022] POST /identity/v3/groups => generated 226 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:43:56.152980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a53425-c127-48be-a337-c641d1b87cf9 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.153281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a53425-c127-48be-a337-c641d1b87cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.153568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a53425-c127-48be-a337-c641d1b87cf9 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.154925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 170/327] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:56.161862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b55094-536e-4bb7-8205-05756f2db80c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.162135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b55094-536e-4bb7-8205-05756f2db80c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.162664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b55094-536e-4bb7-8205-05756f2db80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.180921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-97b55094-536e-4bb7-8205-05756f2db80c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:56.181827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d552b1e-0492-4b8b-bf1e-a38b2d8494ef None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.182069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-97b55094-536e-4bb7-8205-05756f2db80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:56.209410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.219507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e001566-22f7-4745-ae62-dbc4e20f1f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.220155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e001566-22f7-4745-ae62-dbc4e20f1f4f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.220433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e001566-22f7-4745-ae62-dbc4e20f1f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.220706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e001566-22f7-4745-ae62-dbc4e20f1f4f None admin] PATH_INFO: `/v3/users/e280661ff9664c9c86bc57e196f4b394` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.221929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e001566-22f7-4745-ae62-dbc4e20f1f4f None admin] RBAC: Authorizing `identity:get_user(user_id=e280661ff9664c9c86bc57e196f4b394)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.223569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e001566-22f7-4745-ae62-dbc4e20f1f4f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.225404 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 158/328] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/users/e280661ff9664c9c86bc57e196f4b394 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:43:56.231596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e001566-22f7-4745-ae62-dbc4e20f1f4f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.244722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.259175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 171/329] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:56.351385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e001566-22f7-4745-ae62-dbc4e20f1f4f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.389574 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7e42c-4db9-4589-a7bc-1b615e9b8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.390226 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7e42c-4db9-4589-a7bc-1b615e9b8911 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.390503 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7e42c-4db9-4589-a7bc-1b615e9b8911 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.390772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7e42c-4db9-4589-a7bc-1b615e9b8911 None admin] PATH_INFO: `/v3/system/users/e280661ff9664c9c86bc57e196f4b394/roles/1028072c80a14a309ff74e79948a9b25` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.392170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7e42c-4db9-4589-a7bc-1b615e9b8911 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e280661ff9664c9c86bc57e196f4b394, role_id=1028072c80a14a309ff74e79948a9b25)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.393559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7e42c-4db9-4589-a7bc-1b615e9b8911 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.468855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 159/330] 10.222.0.58 () {58 vars in 1334 bytes} [Wed Aug 24 07:43:56 2022] PUT /identity/v3/system/users/e280661ff9664c9c86bc57e196f4b394/roles/1028072c80a14a309ff74e79948a9b25 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:43:56.534490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b55094-536e-4bb7-8205-05756f2db80c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.654885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b55094-536e-4bb7-8205-05756f2db80c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.693826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dcc9d-f731-4170-88d2-9f79cea15e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.694697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dcc9d-f731-4170-88d2-9f79cea15e37 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.695111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dcc9d-f731-4170-88d2-9f79cea15e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.695514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4dcc9d-f731-4170-88d2-9f79cea15e37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.710891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4dcc9d-f731-4170-88d2-9f79cea15e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9f4dcc9d-f731-4170-88d2-9f79cea15e37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:56.852788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:56.854222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:56.855035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 172/331] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:56.855706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7e42c-4db9-4589-a7bc-1b615e9b8911 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.855706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:56.864153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7e42c-4db9-4589-a7bc-1b615e9b8911 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:56.903237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4066b30-68e6-4147-ae17-92dbf33219b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:56.903849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4066b30-68e6-4147-ae17-92dbf33219b7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:56.904173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4066b30-68e6-4147-ae17-92dbf33219b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:56.904458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4066b30-68e6-4147-ae17-92dbf33219b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:56.905351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4066b30-68e6-4147-ae17-92dbf33219b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:56.905791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4066b30-68e6-4147-ae17-92dbf33219b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:56.909038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4066b30-68e6-4147-ae17-92dbf33219b7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:56.919824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 160/332] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:56.924973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dcc9d-f731-4170-88d2-9f79cea15e37 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:56.957890 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:57.052670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4dcc9d-f731-4170-88d2-9f79cea15e37 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:57.088421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7664f4-4b85-4d53-89d3-97c82e17d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:57.089054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7664f4-4b85-4d53-89d3-97c82e17d030 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:57.089326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7664f4-4b85-4d53-89d3-97c82e17d030 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:57.089622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7664f4-4b85-4d53-89d3-97c82e17d030 None admin] PATH_INFO: `/v3/users/74e4bc53122b40039a2ebcedb515f63e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:57.090761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7664f4-4b85-4d53-89d3-97c82e17d030 None admin] RBAC: Authorizing `identity:get_user(user_id=74e4bc53122b40039a2ebcedb515f63e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:57.092192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7664f4-4b85-4d53-89d3-97c82e17d030 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:57.094096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 173/333] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:56 2022] GET /identity/v3/users/74e4bc53122b40039a2ebcedb515f63e => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:57.100432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4066b30-68e6-4147-ae17-92dbf33219b7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:57.227165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4066b30-68e6-4147-ae17-92dbf33219b7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:57.268974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a69fb-f9b2-4e26-96b5-0ba6416a57ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:57.270139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a69fb-f9b2-4e26-96b5-0ba6416a57ef None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:57.270423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a69fb-f9b2-4e26-96b5-0ba6416a57ef None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:57.270826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a69fb-f9b2-4e26-96b5-0ba6416a57ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:57.271580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a69fb-f9b2-4e26-96b5-0ba6416a57ef None admin] RBAC: Adding query filter params (role.id=a9232505007a45c580ef9414aee94847, user.id=74e4bc53122b40039a2ebcedb515f63e, scope.system=all) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:57.271890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a69fb-f9b2-4e26-96b5-0ba6416a57ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:57.273337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a69fb-f9b2-4e26-96b5-0ba6416a57ef None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:57.275099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:57.289529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 161/334] 10.222.0.58 () {56 vars in 1308 bytes} [Wed Aug 24 07:43:57 2022] GET /identity/v3/role_assignments?user.id=74e4bc53122b40039a2ebcedb515f63e&scope.system=all&role.id=a9232505007a45c580ef9414aee94847 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:58.464485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ac0e-4116-4dfe-857b-621036dc422a None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:58.465011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ac0e-4116-4dfe-857b-621036dc422a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:58.465011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ac0e-4116-4dfe-857b-621036dc422a None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:58.466364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 174/335] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:58.471892 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242403a-9525-438a-9966-6320db8fe4f3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:58.472773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242403a-9525-438a-9966-6320db8fe4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:58.473250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242403a-9525-438a-9966-6320db8fe4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:58.494107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1242403a-9525-438a-9966-6320db8fe4f3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:58.495706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1242403a-9525-438a-9966-6320db8fe4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:58.580208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 162/336] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:58.743959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155286fa-624b-4750-ba59-584d0dd8c3a4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:58.744463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155286fa-624b-4750-ba59-584d0dd8c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:58.744871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155286fa-624b-4750-ba59-584d0dd8c3a4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:58.746635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 175/337] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:58.771373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76857-4859-4b32-b792-7e3c58701ebe None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:58.771709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76857-4859-4b32-b792-7e3c58701ebe None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:58.771941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f76857-4859-4b32-b792-7e3c58701ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:58.779300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083bcb-1efb-46cb-9302-baacba4f8080 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:58.779854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083bcb-1efb-46cb-9302-baacba4f8080 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:58.780332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083bcb-1efb-46cb-9302-baacba4f8080 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:58.782318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 176/338] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:43:58.788323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cd658-5cce-43a8-af75-192fbbdcedb8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:58.788868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cd658-5cce-43a8-af75-192fbbdcedb8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:58.789346 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cd658-5cce-43a8-af75-192fbbdcedb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:58.798963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c4f76857-4859-4b32-b792-7e3c58701ebe None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:58.800170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c4f76857-4859-4b32-b792-7e3c58701ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:58.810869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-714cd658-5cce-43a8-af75-192fbbdcedb8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:43:58.812606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-714cd658-5cce-43a8-af75-192fbbdcedb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:43:58.903091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 163/339] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:58.937845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f76857-4859-4b32-b792-7e3c58701ebe None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:58.965568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 177/340] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:43:59.030912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:59.065951 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f76857-4859-4b32-b792-7e3c58701ebe None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:59.109297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a16f9-2bc3-4883-95d5-b82a9499421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:59.110025 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a16f9-2bc3-4883-95d5-b82a9499421a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.110304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a16f9-2bc3-4883-95d5-b82a9499421a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.110579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a16f9-2bc3-4883-95d5-b82a9499421a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.122827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a16f9-2bc3-4883-95d5-b82a9499421a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-c49a16f9-2bc3-4883-95d5-b82a9499421a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:59.127802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:59.129280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:43:59.130110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:43:59.133570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 164/341] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:43:59.135946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cd658-5cce-43a8-af75-192fbbdcedb8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:59.156751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:59.257519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cd658-5cce-43a8-af75-192fbbdcedb8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:59.297100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f26ed-c74a-4bcb-a10b-f66c74786697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:59.297652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f26ed-c74a-4bcb-a10b-f66c74786697 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.297926 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f26ed-c74a-4bcb-a10b-f66c74786697 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.298191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f26ed-c74a-4bcb-a10b-f66c74786697 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.298857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f26ed-c74a-4bcb-a10b-f66c74786697 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:59.299152 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f26ed-c74a-4bcb-a10b-f66c74786697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:59.300545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f26ed-c74a-4bcb-a10b-f66c74786697 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:59.313566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 178/342] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:59.323113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a16f9-2bc3-4883-95d5-b82a9499421a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:59.417328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f26ed-c74a-4bcb-a10b-f66c74786697 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:59.460800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a16f9-2bc3-4883-95d5-b82a9499421a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:59.481838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:59.515706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc56d5-2fca-4c81-be7e-f7962b69a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:59.516317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc56d5-2fca-4c81-be7e-f7962b69a350 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.516596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc56d5-2fca-4c81-be7e-f7962b69a350 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.516867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc56d5-2fca-4c81-be7e-f7962b69a350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.585592 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:59.609832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f26ed-c74a-4bcb-a10b-f66c74786697 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:59.615296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc56d5-2fca-4c81-be7e-f7962b69a350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:59.619152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc56d5-2fca-4c81-be7e-f7962b69a350 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:59.709569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868c98a-4d4c-4f43-a4ec-9be1897e368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:59.710212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868c98a-4d4c-4f43-a4ec-9be1897e368f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.710485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868c98a-4d4c-4f43-a4ec-9be1897e368f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.710755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868c98a-4d4c-4f43-a4ec-9be1897e368f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.733502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868c98a-4d4c-4f43-a4ec-9be1897e368f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f868c98a-4d4c-4f43-a4ec-9be1897e368f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:59.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:59.740203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:43:59.741595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:59.746850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 179/343] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:59.747749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868c98a-4d4c-4f43-a4ec-9be1897e368f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:59.769965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 165/344] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:59.771229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc56d5-2fca-4c81-be7e-f7962b69a350 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:59.786928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:59.898795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868c98a-4d4c-4f43-a4ec-9be1897e368f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:59.902772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc56d5-2fca-4c81-be7e-f7962b69a350 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:43:59.946346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8eec1-c9e6-4bba-9ac0-accd68782dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:59.946960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8eec1-c9e6-4bba-9ac0-accd68782dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.947234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8eec1-c9e6-4bba-9ac0-accd68782dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.947505 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8eec1-c9e6-4bba-9ac0-accd68782dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.948171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8eec1-c9e6-4bba-9ac0-accd68782dc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:43:59.948466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8eec1-c9e6-4bba-9ac0-accd68782dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:43:59.949084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b4389-ab23-4b73-956e-5d15e37ce792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:43:59.949766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b4389-ab23-4b73-956e-5d15e37ce792 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.949881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8eec1-c9e6-4bba-9ac0-accd68782dc1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:43:59.950046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b4389-ab23-4b73-956e-5d15e37ce792 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.950303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b4389-ab23-4b73-956e-5d15e37ce792 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.960207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:59.962501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 166/345] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:43:59.963785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ceaea-5c8f-4039-8d7a-5e1ca53124ac None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:43:59.964069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ceaea-5c8f-4039-8d7a-5e1ca53124ac None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:43:59.964338 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ceaea-5c8f-4039-8d7a-5e1ca53124ac None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:43:59.965075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b4389-ab23-4b73-956e-5d15e37ce792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:43:59.965808 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 167/346] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:43:59.966528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ceaea-5c8f-4039-8d7a-5e1ca53124ac None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4a5b4389-ab23-4b73-956e-5d15e37ce792 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:43:59.974298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:43:59.976866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 180/347] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:43:59.977705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b4389-ab23-4b73-956e-5d15e37ce792 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.062418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.096054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ceaea-5c8f-4039-8d7a-5e1ca53124ac None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.118967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b4389-ab23-4b73-956e-5d15e37ce792 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.150001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d397-d351-491b-b68f-d2707492e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.150564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d397-d351-491b-b68f-d2707492e411 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.150841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d397-d351-491b-b68f-d2707492e411 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.151114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d397-d351-491b-b68f-d2707492e411 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.152983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1d397-d351-491b-b68f-d2707492e411 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.154764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1d397-d351-491b-b68f-d2707492e411 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.157386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 168/348] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:00.161437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91700d1b-6838-4aaa-833f-bec30dcb8e6c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.161437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91700d1b-6838-4aaa-833f-bec30dcb8e6c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.161437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91700d1b-6838-4aaa-833f-bec30dcb8e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.171635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2d9f9-5b47-48b9-8c68-181dfb9ced14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.172602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d9f9-5b47-48b9-8c68-181dfb9ced14 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.173070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d9f9-5b47-48b9-8c68-181dfb9ced14 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.173623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d9f9-5b47-48b9-8c68-181dfb9ced14 None admin] PATH_INFO: `/v3/users/e280661ff9664c9c86bc57e196f4b394` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.175115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2d9f9-5b47-48b9-8c68-181dfb9ced14 None admin] RBAC: Authorizing `identity:get_user(user_id=e280661ff9664c9c86bc57e196f4b394)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.176796 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2d9f9-5b47-48b9-8c68-181dfb9ced14 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.183570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 181/349] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:43:59 2022] GET /identity/v3/users/e280661ff9664c9c86bc57e196f4b394 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:00.184408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-91700d1b-6838-4aaa-833f-bec30dcb8e6c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:00.184889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2d9f9-5b47-48b9-8c68-181dfb9ced14 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.185658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-91700d1b-6838-4aaa-833f-bec30dcb8e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:00.270612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 169/350] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:00.272492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91700d1b-6838-4aaa-833f-bec30dcb8e6c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.280767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.334396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2d9f9-5b47-48b9-8c68-181dfb9ced14 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.390681 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.412671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71851c-4912-4b14-a60b-b948c56675a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.413648 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71851c-4912-4b14-a60b-b948c56675a0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.414118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71851c-4912-4b14-a60b-b948c56675a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.414589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71851c-4912-4b14-a60b-b948c56675a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.416302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71851c-4912-4b14-a60b-b948c56675a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:00.416803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71851c-4912-4b14-a60b-b948c56675a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.420004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71851c-4912-4b14-a60b-b948c56675a0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.436774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 182/351] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:00.438809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71851c-4912-4b14-a60b-b948c56675a0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.449637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91700d1b-6838-4aaa-833f-bec30dcb8e6c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.494921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc1c6-f205-403f-8ed5-a6f5de8ade65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.496552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc1c6-f205-403f-8ed5-a6f5de8ade65 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.497021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc1c6-f205-403f-8ed5-a6f5de8ade65 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.497691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc1c6-f205-403f-8ed5-a6f5de8ade65 None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.504477 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc1c6-f205-403f-8ed5-a6f5de8ade65 None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.506498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc1c6-f205-403f-8ed5-a6f5de8ade65 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.508537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 170/352] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:00 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:00.510858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc1c6-f205-403f-8ed5-a6f5de8ade65 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.575329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71851c-4912-4b14-a60b-b948c56675a0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.613830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.617167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab481d2-1a61-4db7-9c46-a06dfe8949fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.617831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab481d2-1a61-4db7-9c46-a06dfe8949fa None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.618113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab481d2-1a61-4db7-9c46-a06dfe8949fa None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.618387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab481d2-1a61-4db7-9c46-a06dfe8949fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.619119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab481d2-1a61-4db7-9c46-a06dfe8949fa None admin] RBAC: Adding query filter params (role.id=1028072c80a14a309ff74e79948a9b25, user.id=e280661ff9664c9c86bc57e196f4b394, scope.system=all) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:00.619425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab481d2-1a61-4db7-9c46-a06dfe8949fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.621014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab481d2-1a61-4db7-9c46-a06dfe8949fa None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.623197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc1c6-f205-403f-8ed5-a6f5de8ade65 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.635552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 183/353] 10.222.0.58 () {56 vars in 1308 bytes} [Wed Aug 24 07:44:00 2022] GET /identity/v3/role_assignments?user.id=e280661ff9664c9c86bc57e196f4b394&scope.system=all&role.id=1028072c80a14a309ff74e79948a9b25 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:00.637619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab481d2-1a61-4db7-9c46-a06dfe8949fa None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.679091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bc0a8-2690-49ba-a661-4fd579c13061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.679631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bc0a8-2690-49ba-a661-4fd579c13061 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.679903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bc0a8-2690-49ba-a661-4fd579c13061 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.680164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bc0a8-2690-49ba-a661-4fd579c13061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.691881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.770925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab481d2-1a61-4db7-9c46-a06dfe8949fa None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:00.786695 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bc0a8-2690-49ba-a661-4fd579c13061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.788891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bc0a8-2690-49ba-a661-4fd579c13061 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.822929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dcd36-f859-4c55-94ad-32371f958585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:00.823553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dcd36-f859-4c55-94ad-32371f958585 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.824230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dcd36-f859-4c55-94ad-32371f958585 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.824498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dcd36-f859-4c55-94ad-32371f958585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.825582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dcd36-f859-4c55-94ad-32371f958585 None admin] RBAC: Adding query filter params (group.id=ed976fadbfdc4d50bc3c063490f1c9ad, role.id=a9232505007a45c580ef9414aee94847, scope.project.id=b5171171f9c44ffe896d40e40391d4a1) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:00.825893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dcd36-f859-4c55-94ad-32371f958585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:00.827560 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dcd36-f859-4c55-94ad-32371f958585 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:00.839467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 184/354] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:00 2022] GET /identity/v3/role_assignments?group.id=ed976fadbfdc4d50bc3c063490f1c9ad&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=a9232505007a45c580ef9414aee94847 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:00.840244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2a3d-9d54-4e3b-8482-5703248c3567 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.840531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2a3d-9d54-4e3b-8482-5703248c3567 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.840803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d2a3d-9d54-4e3b-8482-5703248c3567 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.843239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 185/355] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:00.843239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d2a3d-9d54-4e3b-8482-5703248c3567 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:00.928891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:00.946595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 171/356] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:00.946595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3eb35-4248-4f8f-8c6c-586c6eace5f7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:00.946595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3eb35-4248-4f8f-8c6c-586c6eace5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:00.947119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3eb35-4248-4f8f-8c6c-586c6eace5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:00.968387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-8bc3eb35-4248-4f8f-8c6c-586c6eace5f7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:00.969649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8bc3eb35-4248-4f8f-8c6c-586c6eace5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:01.001163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d2a3d-9d54-4e3b-8482-5703248c3567 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.002049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.046221 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 172/357] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:01.047170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3eb35-4248-4f8f-8c6c-586c6eace5f7 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.067685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f18c-030b-42af-a934-a3ae674ca455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.070212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f18c-030b-42af-a934-a3ae674ca455 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.070497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f18c-030b-42af-a934-a3ae674ca455 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.070767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f18c-030b-42af-a934-a3ae674ca455 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.099786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f18c-030b-42af-a934-a3ae674ca455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-fb31f18c-030b-42af-a934-a3ae674ca455 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:01.109702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:01.110627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:01.111420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:01.114067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 186/358] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:01.118624 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f18c-030b-42af-a934-a3ae674ca455 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.219017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3eb35-4248-4f8f-8c6c-586c6eace5f7 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.240111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f18c-030b-42af-a934-a3ae674ca455 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.254530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.260926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee13e02-56e7-4c33-8e1d-dd4e28314ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.270413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee13e02-56e7-4c33-8e1d-dd4e28314ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.270413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee13e02-56e7-4c33-8e1d-dd4e28314ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.270413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee13e02-56e7-4c33-8e1d-dd4e28314ae4 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.270413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee13e02-56e7-4c33-8e1d-dd4e28314ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.270413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee13e02-56e7-4c33-8e1d-dd4e28314ae4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.270413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 173/359] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:01.272525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee13e02-56e7-4c33-8e1d-dd4e28314ae4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.278492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d4937-4f62-416e-9ecc-2d170890bcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.279168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4937-4f62-416e-9ecc-2d170890bcab None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.279440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4937-4f62-416e-9ecc-2d170890bcab None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.279721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4937-4f62-416e-9ecc-2d170890bcab None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.280425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d4937-4f62-416e-9ecc-2d170890bcab None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:01.280724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d4937-4f62-416e-9ecc-2d170890bcab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.282215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d4937-4f62-416e-9ecc-2d170890bcab None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.294450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 187/360] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:01.299609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d4937-4f62-416e-9ecc-2d170890bcab None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.325415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.417362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee13e02-56e7-4c33-8e1d-dd4e28314ae4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.457333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d4937-4f62-416e-9ecc-2d170890bcab None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.461288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4123bd8-5ba4-4b7a-972a-f82c69fdb876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.462153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4123bd8-5ba4-4b7a-972a-f82c69fdb876 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.462577 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4123bd8-5ba4-4b7a-972a-f82c69fdb876 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.463013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4123bd8-5ba4-4b7a-972a-f82c69fdb876 None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.464282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4123bd8-5ba4-4b7a-972a-f82c69fdb876 None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.465889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4123bd8-5ba4-4b7a-972a-f82c69fdb876 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.467687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 174/361] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:01.469085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d754280-cb9f-4426-877a-3a6c6df40e71 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.469664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d754280-cb9f-4426-877a-3a6c6df40e71 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.470135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d754280-cb9f-4426-877a-3a6c6df40e71 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.471802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 175/362] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:01.474139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d754280-cb9f-4426-877a-3a6c6df40e71 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.500084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c18b8-83d8-46ee-9410-8ff296332600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.500792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c18b8-83d8-46ee-9410-8ff296332600 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.501100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c18b8-83d8-46ee-9410-8ff296332600 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.501363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c18b8-83d8-46ee-9410-8ff296332600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.550513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.579417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c18b8-83d8-46ee-9410-8ff296332600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.581696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c18b8-83d8-46ee-9410-8ff296332600 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.593234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d754280-cb9f-4426-877a-3a6c6df40e71 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.594954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.633990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41dedb-eda7-486a-a4c4-7df8fd70d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.634344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41dedb-eda7-486a-a4c4-7df8fd70d23b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.634576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41dedb-eda7-486a-a4c4-7df8fd70d23b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.634843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41dedb-eda7-486a-a4c4-7df8fd70d23b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.635578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41dedb-eda7-486a-a4c4-7df8fd70d23b None admin] RBAC: Adding query filter params (group.id=ed976fadbfdc4d50bc3c063490f1c9ad, role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=b5171171f9c44ffe896d40e40391d4a1) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:01.635882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41dedb-eda7-486a-a4c4-7df8fd70d23b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.637317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41dedb-eda7-486a-a4c4-7df8fd70d23b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.646385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 176/363] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/role_assignments?group.id=ed976fadbfdc4d50bc3c063490f1c9ad&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:01.647413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99cafb-cd90-4ffe-a19b-c88abcb7108d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.647770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99cafb-cd90-4ffe-a19b-c88abcb7108d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.648379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99cafb-cd90-4ffe-a19b-c88abcb7108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.672962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0c99cafb-cd90-4ffe-a19b-c88abcb7108d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:01.674646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0c99cafb-cd90-4ffe-a19b-c88abcb7108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:01.719975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 188/364] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:01.721837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c18b8-83d8-46ee-9410-8ff296332600 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.767549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 177/365] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:01.774763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99cafb-cd90-4ffe-a19b-c88abcb7108d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.820118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.850564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c18b8-83d8-46ee-9410-8ff296332600 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.889975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a4aa2-cdc7-40ba-ae28-57305ec1f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.890908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4aa2-cdc7-40ba-ae28-57305ec1f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.891365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4aa2-cdc7-40ba-ae28-57305ec1f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.891894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4aa2-cdc7-40ba-ae28-57305ec1f9c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.904527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a4aa2-cdc7-40ba-ae28-57305ec1f9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:01.910915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-608a4aa2-cdc7-40ba-ae28-57305ec1f9c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:01.913283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:01.914187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:01.914972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:01.917337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99cafb-cd90-4ffe-a19b-c88abcb7108d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:01.917744 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 189/366] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:01.923615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a4aa2-cdc7-40ba-ae28-57305ec1f9c5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:01.967047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87acbf-0fa7-4ad0-8a88-97f6f0ce2128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:01.967853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87acbf-0fa7-4ad0-8a88-97f6f0ce2128 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:01.968194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87acbf-0fa7-4ad0-8a88-97f6f0ce2128 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:01.968528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87acbf-0fa7-4ad0-8a88-97f6f0ce2128 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:01.969795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87acbf-0fa7-4ad0-8a88-97f6f0ce2128 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:01.971339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87acbf-0fa7-4ad0-8a88-97f6f0ce2128 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:01.974424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 178/367] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:01.980079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87acbf-0fa7-4ad0-8a88-97f6f0ce2128 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:02.083557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a4aa2-cdc7-40ba-ae28-57305ec1f9c5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:02.150081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87acbf-0fa7-4ad0-8a88-97f6f0ce2128 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:02.166771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363deac-e598-41a1-88a7-b5e321264328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:02.167397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363deac-e598-41a1-88a7-b5e321264328 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:02.167680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363deac-e598-41a1-88a7-b5e321264328 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:02.167956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363deac-e598-41a1-88a7-b5e321264328 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:02.168638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363deac-e598-41a1-88a7-b5e321264328 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:02.168940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363deac-e598-41a1-88a7-b5e321264328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:02.170362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363deac-e598-41a1-88a7-b5e321264328 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:02.172098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:02.190413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd78cbd-a0fb-4d03-a9b8-2f2207933852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:02.191958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd78cbd-a0fb-4d03-a9b8-2f2207933852 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:02.192403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 190/368] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:02.192657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd78cbd-a0fb-4d03-a9b8-2f2207933852 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:02.193140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd78cbd-a0fb-4d03-a9b8-2f2207933852 None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:02.194540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd78cbd-a0fb-4d03-a9b8-2f2207933852 None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:02.196272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd78cbd-a0fb-4d03-a9b8-2f2207933852 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:02.202443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363deac-e598-41a1-88a7-b5e321264328 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:02.203169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 179/369] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:01 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:02.209688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd78cbd-a0fb-4d03-a9b8-2f2207933852 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:02.261960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:02.352695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363deac-e598-41a1-88a7-b5e321264328 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:02.352884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd78cbd-a0fb-4d03-a9b8-2f2207933852 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:02.402654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd9f94-6317-46fc-ac5f-7500ae80b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:02.402879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9f94-6317-46fc-ac5f-7500ae80b28d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:02.403098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9f94-6317-46fc-ac5f-7500ae80b28d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:02.403282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9f94-6317-46fc-ac5f-7500ae80b28d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:02.403953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a2b0d-a947-44b2-8829-1ae5395ebafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:02.404546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a2b0d-a947-44b2-8829-1ae5395ebafe None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:02.404812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a2b0d-a947-44b2-8829-1ae5395ebafe None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:02.405077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a2b0d-a947-44b2-8829-1ae5395ebafe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:02.405891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a2b0d-a947-44b2-8829-1ae5395ebafe None admin] RBAC: Adding query filter params (group.id=ed976fadbfdc4d50bc3c063490f1c9ad, role.id=a9232505007a45c580ef9414aee94847, scope.project.id=97d4b1bf1bff4d36a820888731015eaf) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:02.406193 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a2b0d-a947-44b2-8829-1ae5395ebafe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:02.407610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a2b0d-a947-44b2-8829-1ae5395ebafe None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:02.415512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 180/370] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:02 2022] GET /identity/v3/role_assignments?group.id=ed976fadbfdc4d50bc3c063490f1c9ad&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=a9232505007a45c580ef9414aee94847 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:02.416452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a2b0d-a947-44b2-8829-1ae5395ebafe None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:02.481148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:02.489777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd9f94-6317-46fc-ac5f-7500ae80b28d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:02.491551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd9f94-6317-46fc-ac5f-7500ae80b28d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:02.546624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a2b0d-a947-44b2-8829-1ae5395ebafe None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:02.549846 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:02.594046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e69678-f8cc-4d7c-a1d6-261fd0b0e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:02.594814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e69678-f8cc-4d7c-a1d6-261fd0b0e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:02.594998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e69678-f8cc-4d7c-a1d6-261fd0b0e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:02.595283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e69678-f8cc-4d7c-a1d6-261fd0b0e4e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:02.610718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e69678-f8cc-4d7c-a1d6-261fd0b0e4e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d8e69678-f8cc-4d7c-a1d6-261fd0b0e4e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:02.616624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:02.617602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:02.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 181/371] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:02.623798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e69678-f8cc-4d7c-a1d6-261fd0b0e4e9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:02.631603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 191/372] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:02.637723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd9f94-6317-46fc-ac5f-7500ae80b28d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:02.735910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e69678-f8cc-4d7c-a1d6-261fd0b0e4e9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:02.744054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:02.752041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd9f94-6317-46fc-ac5f-7500ae80b28d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:02.775658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f07cae-726a-4646-8682-a762c898ae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:02.776379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f07cae-726a-4646-8682-a762c898ae69 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:02.776738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f07cae-726a-4646-8682-a762c898ae69 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:02.777070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f07cae-726a-4646-8682-a762c898ae69 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:02.777863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f07cae-726a-4646-8682-a762c898ae69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:02.778230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f07cae-726a-4646-8682-a762c898ae69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:02.779718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f07cae-726a-4646-8682-a762c898ae69 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:02.796085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 182/373] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:02.797370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f07cae-726a-4646-8682-a762c898ae69 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:02.799581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a160d2-ac6d-415d-9993-83bb17d5518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:02.801109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a160d2-ac6d-415d-9993-83bb17d5518d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:02.801718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a160d2-ac6d-415d-9993-83bb17d5518d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:02.802379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a160d2-ac6d-415d-9993-83bb17d5518d None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:02.804623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a160d2-ac6d-415d-9993-83bb17d5518d None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:02.806418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a160d2-ac6d-415d-9993-83bb17d5518d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:02.808631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 192/374] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:02 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:02.814246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a160d2-ac6d-415d-9993-83bb17d5518d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:02.828897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:02.914141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f07cae-726a-4646-8682-a762c898ae69 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:02.953532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594ca0-a99a-48cf-bae4-00b2734cc29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:02.954282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594ca0-a99a-48cf-bae4-00b2734cc29c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:02.954913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594ca0-a99a-48cf-bae4-00b2734cc29c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:02.955183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594ca0-a99a-48cf-bae4-00b2734cc29c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.029372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a160d2-ac6d-415d-9993-83bb17d5518d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:03.029730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77594ca0-a99a-48cf-bae4-00b2734cc29c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:03.031206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77594ca0-a99a-48cf-bae4-00b2734cc29c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:03.051821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:03.100585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5f05-65db-45ca-bccb-52141cc1a8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:03.101235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5f05-65db-45ca-bccb-52141cc1a8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.101549 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5f05-65db-45ca-bccb-52141cc1a8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.101811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5f05-65db-45ca-bccb-52141cc1a8b3 None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.104118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce5f05-65db-45ca-bccb-52141cc1a8b3 None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:03.105905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce5f05-65db-45ca-bccb-52141cc1a8b3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:03.107787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 193/375] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:02 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:03.115587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5f05-65db-45ca-bccb-52141cc1a8b3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:03.181857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:03.203315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 183/376] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:03.212214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022fc9f-e819-4446-b5fc-3d1a63f213e4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.212662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022fc9f-e819-4446-b5fc-3d1a63f213e4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.212766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022fc9f-e819-4446-b5fc-3d1a63f213e4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.214368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 184/377] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:03.215076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022fc9f-e819-4446-b5fc-3d1a63f213e4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:03.267156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5f05-65db-45ca-bccb-52141cc1a8b3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:03.331224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e34b-a4a1-4b6e-8967-5bbe5492ee8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:03.331822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e34b-a4a1-4b6e-8967-5bbe5492ee8c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.332096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e34b-a4a1-4b6e-8967-5bbe5492ee8c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.332362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e34b-a4a1-4b6e-8967-5bbe5492ee8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.333955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e34b-a4a1-4b6e-8967-5bbe5492ee8c None admin] RBAC: Adding query filter params (group.id=ed976fadbfdc4d50bc3c063490f1c9ad, role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=97d4b1bf1bff4d36a820888731015eaf) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:03.334260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e34b-a4a1-4b6e-8967-5bbe5492ee8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:03.336301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e34b-a4a1-4b6e-8967-5bbe5492ee8c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:03.348700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 194/378] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:03 2022] GET /identity/v3/role_assignments?group.id=ed976fadbfdc4d50bc3c063490f1c9ad&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:03.348700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57132dba-7e68-4cdb-9e5d-1cee5bab4bb5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.348978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57132dba-7e68-4cdb-9e5d-1cee5bab4bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.349256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57132dba-7e68-4cdb-9e5d-1cee5bab4bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.351318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022fc9f-e819-4446-b5fc-3d1a63f213e4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:03.371703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-57132dba-7e68-4cdb-9e5d-1cee5bab4bb5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:03.372927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-57132dba-7e68-4cdb-9e5d-1cee5bab4bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:03.419286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:03.462107 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 195/379] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:03.478272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029ea95-4bff-42dd-a335-b3ca43047b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:03.478931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029ea95-4bff-42dd-a335-b3ca43047b89 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.479209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029ea95-4bff-42dd-a335-b3ca43047b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.479482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029ea95-4bff-42dd-a335-b3ca43047b89 None admin] PATH_INFO: `/v3/projects/28aa92351f744eeb9273dbf7547e3314` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.480692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029ea95-4bff-42dd-a335-b3ca43047b89 None admin] RBAC: Authorizing `identity:get_project(project_id=28aa92351f744eeb9273dbf7547e3314)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:03.482197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029ea95-4bff-42dd-a335-b3ca43047b89 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:03.484151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 185/380] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:03 2022] GET /identity/v3/projects/28aa92351f744eeb9273dbf7547e3314 => generated 344 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:03.489988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57132dba-7e68-4cdb-9e5d-1cee5bab4bb5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:03.520618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:03.598795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57132dba-7e68-4cdb-9e5d-1cee5bab4bb5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:03.633561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4e32-9b02-470a-be77-611aee2c0f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:03.634179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4e32-9b02-470a-be77-611aee2c0f08 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.634452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4e32-9b02-470a-be77-611aee2c0f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.634717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4e32-9b02-470a-be77-611aee2c0f08 None admin] PATH_INFO: `/v3/groups/b3925bcaacb54693848c2c6dc9289dcb` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.640725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4e32-9b02-470a-be77-611aee2c0f08 None admin] RBAC: Authorizing `identity:get_group(group_id=b3925bcaacb54693848c2c6dc9289dcb)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:03.642191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4e32-9b02-470a-be77-611aee2c0f08 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:03.644488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 196/381] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:03 2022] GET /identity/v3/groups/b3925bcaacb54693848c2c6dc9289dcb => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:03.651348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029ea95-4bff-42dd-a335-b3ca43047b89 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:03.767299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029ea95-4bff-42dd-a335-b3ca43047b89 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:03.803466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ad94e-6ce3-42ef-ae38-eddd21cc24f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:03.804307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ad94e-6ce3-42ef-ae38-eddd21cc24f8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:03.804742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ad94e-6ce3-42ef-ae38-eddd21cc24f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:03.805165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ad94e-6ce3-42ef-ae38-eddd21cc24f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:03.806150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ad94e-6ce3-42ef-ae38-eddd21cc24f8 None admin] RBAC: Adding query filter params (group.id=b3925bcaacb54693848c2c6dc9289dcb, role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=28aa92351f744eeb9273dbf7547e3314) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:03.806607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ad94e-6ce3-42ef-ae38-eddd21cc24f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:03.808153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ad94e-6ce3-42ef-ae38-eddd21cc24f8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:03.814939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4e32-9b02-470a-be77-611aee2c0f08 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:03.821566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 186/382] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:03 2022] GET /identity/v3/role_assignments?group.id=b3925bcaacb54693848c2c6dc9289dcb&scope.project.id=28aa92351f744eeb9273dbf7547e3314&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:03.944406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:03.955224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4e32-9b02-470a-be77-611aee2c0f08 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:04.012238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1a05-4fdc-490d-91f5-844e3a8fd4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:04.012908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1a05-4fdc-490d-91f5-844e3a8fd4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.013196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1a05-4fdc-490d-91f5-844e3a8fd4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.013558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d1a05-4fdc-490d-91f5-844e3a8fd4b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.030925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d1a05-4fdc-490d-91f5-844e3a8fd4b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-8b5d1a05-4fdc-490d-91f5-844e3a8fd4b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:04.035980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:04.037111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:04.038332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 197/383] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:04.044233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ad94e-6ce3-42ef-ae38-eddd21cc24f8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:04.101356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:04.160785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ad94e-6ce3-42ef-ae38-eddd21cc24f8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:04.199365 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f77ba4-2cde-46c3-a6c4-ddec73b37e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:04.199894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f77ba4-2cde-46c3-a6c4-ddec73b37e26 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.200172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f77ba4-2cde-46c3-a6c4-ddec73b37e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.200443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f77ba4-2cde-46c3-a6c4-ddec73b37e26 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.201109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f77ba4-2cde-46c3-a6c4-ddec73b37e26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:04.201407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f77ba4-2cde-46c3-a6c4-ddec73b37e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:04.202793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f77ba4-2cde-46c3-a6c4-ddec73b37e26 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:04.214314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 187/384] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:04.219897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1a05-4fdc-490d-91f5-844e3a8fd4b8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:04.314257 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc12c1-73e4-4604-b61b-6624f94d5d15 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.314573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc12c1-73e4-4604-b61b-6624f94d5d15 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.314812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc12c1-73e4-4604-b61b-6624f94d5d15 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.322254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 188/385] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:04.330828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4c18-3c33-44d9-b13b-30e56fb119b5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.331112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4c18-3c33-44d9-b13b-30e56fb119b5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.331387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4c18-3c33-44d9-b13b-30e56fb119b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.358435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d1a05-4fdc-490d-91f5-844e3a8fd4b8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:04.377389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-551e4c18-3c33-44d9-b13b-30e56fb119b5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:04.378653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-551e4c18-3c33-44d9-b13b-30e56fb119b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:04.447723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ae3fe-3291-49b2-b1c5-cca9ba464495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:04.448360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae3fe-3291-49b2-b1c5-cca9ba464495 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.448680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae3fe-3291-49b2-b1c5-cca9ba464495 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.448953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ae3fe-3291-49b2-b1c5-cca9ba464495 None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.451830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ae3fe-3291-49b2-b1c5-cca9ba464495 None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:04.453349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ae3fe-3291-49b2-b1c5-cca9ba464495 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:04.455065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 198/386] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:04 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:04.462125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ae3fe-3291-49b2-b1c5-cca9ba464495 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:04.500409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:04.511682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 189/387] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:04.591818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ae3fe-3291-49b2-b1c5-cca9ba464495 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:04.627583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aac25-b2ee-4f16-b227-db90eb120bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:04.628219 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aac25-b2ee-4f16-b227-db90eb120bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.629016 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aac25-b2ee-4f16-b227-db90eb120bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.629286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aac25-b2ee-4f16-b227-db90eb120bf8 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.630544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aac25-b2ee-4f16-b227-db90eb120bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:04.631998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aac25-b2ee-4f16-b227-db90eb120bf8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:04.634006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 199/388] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:04 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:04.639821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4c18-3c33-44d9-b13b-30e56fb119b5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:04.695126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:04.764347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4c18-3c33-44d9-b13b-30e56fb119b5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:04.808679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc450e1a-11b9-4a88-a7dd-034dd2c5b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:04.813895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc450e1a-11b9-4a88-a7dd-034dd2c5b0aa None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:04.814351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc450e1a-11b9-4a88-a7dd-034dd2c5b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:04.814772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc450e1a-11b9-4a88-a7dd-034dd2c5b0aa None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1/groups/ed976fadbfdc4d50bc3c063490f1c9ad/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:04.815291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aac25-b2ee-4f16-b227-db90eb120bf8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:04.818104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc450e1a-11b9-4a88-a7dd-034dd2c5b0aa None admin] RBAC: Authorizing `identity:create_grant(project_id=b5171171f9c44ffe896d40e40391d4a1, group_id=ed976fadbfdc4d50bc3c063490f1c9ad, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:04.819721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc450e1a-11b9-4a88-a7dd-034dd2c5b0aa None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:04.897755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 190/389] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:04 2022] PUT /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1/groups/ed976fadbfdc4d50bc3c063490f1c9ad/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:04.958399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:04.976275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aac25-b2ee-4f16-b227-db90eb120bf8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:05.018083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9dd81-a471-443b-a397-fc9ad3df9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:05.019040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9dd81-a471-443b-a397-fc9ad3df9c38 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:05.019440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9dd81-a471-443b-a397-fc9ad3df9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:05.019874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9dd81-a471-443b-a397-fc9ad3df9c38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:05.031178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9dd81-a471-443b-a397-fc9ad3df9c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-fbd9dd81-a471-443b-a397-fc9ad3df9c38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:05.036609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:05.037849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:05.038653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:05.040882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 200/390] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:05.051526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc450e1a-11b9-4a88-a7dd-034dd2c5b0aa None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:05.184877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc450e1a-11b9-4a88-a7dd-034dd2c5b0aa None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:05.186830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:05.225754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc39484-2ea2-48a6-9d86-d8287190e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:05.226748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc39484-2ea2-48a6-9d86-d8287190e63a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:05.227178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc39484-2ea2-48a6-9d86-d8287190e63a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:05.227565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc39484-2ea2-48a6-9d86-d8287190e63a None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:05.228361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc39484-2ea2-48a6-9d86-d8287190e63a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:05.228779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc39484-2ea2-48a6-9d86-d8287190e63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:05.230287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc39484-2ea2-48a6-9d86-d8287190e63a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:05.240137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 191/391] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:05.245910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9dd81-a471-443b-a397-fc9ad3df9c38 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:05.376270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9dd81-a471-443b-a397-fc9ad3df9c38 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:05.414025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c9cd9-02b6-4ac9-9579-d609b3698224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:05.414930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c9cd9-02b6-4ac9-9579-d609b3698224 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:05.415345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c9cd9-02b6-4ac9-9579-d609b3698224 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:05.415753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c9cd9-02b6-4ac9-9579-d609b3698224 None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:05.417065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c9cd9-02b6-4ac9-9579-d609b3698224 None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:05.418812 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c9cd9-02b6-4ac9-9579-d609b3698224 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:05.420522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 201/392] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:05 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:05.428243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc39484-2ea2-48a6-9d86-d8287190e63a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:05.542855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc39484-2ea2-48a6-9d86-d8287190e63a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:05.567762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050d72-384f-4847-8957-85d37fbb3967 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:05.568380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050d72-384f-4847-8957-85d37fbb3967 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:05.568842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f050d72-384f-4847-8957-85d37fbb3967 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:05.570851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 202/393] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:05.579866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b75701-a453-4fb2-aeb0-f9dfe689d1c8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:05.580420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b75701-a453-4fb2-aeb0-f9dfe689d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:05.580881 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b75701-a453-4fb2-aeb0-f9dfe689d1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:05.604921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c188-25c7-4dcf-b9a3-175cf1027513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:05.606245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c188-25c7-4dcf-b9a3-175cf1027513 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:05.607993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c188-25c7-4dcf-b9a3-175cf1027513 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:05.608515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7c188-25c7-4dcf-b9a3-175cf1027513 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:05.611344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7c188-25c7-4dcf-b9a3-175cf1027513 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:05.614778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-05b75701-a453-4fb2-aeb0-f9dfe689d1c8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:05.616257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-05b75701-a453-4fb2-aeb0-f9dfe689d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:05.616488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7c188-25c7-4dcf-b9a3-175cf1027513 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:05.624806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 192/394] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:05 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:05.635093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:05.644876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c188-25c7-4dcf-b9a3-175cf1027513 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:05.709065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:05.721984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 203/395] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:05.818981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7c188-25c7-4dcf-b9a3-175cf1027513 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:05.872472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf62cf8-2ac7-4dc9-8358-8fef090530ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:05.873530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf62cf8-2ac7-4dc9-8358-8fef090530ad None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:05.874026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf62cf8-2ac7-4dc9-8358-8fef090530ad None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:05.874495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf62cf8-2ac7-4dc9-8358-8fef090530ad None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1/groups/ed976fadbfdc4d50bc3c063490f1c9ad/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:05.876848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf62cf8-2ac7-4dc9-8358-8fef090530ad None admin] RBAC: Authorizing `identity:create_grant(project_id=b5171171f9c44ffe896d40e40391d4a1, group_id=ed976fadbfdc4d50bc3c063490f1c9ad, role_id=6a99e3ee2e8546c8a6cc6f4e33997bfd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:05.878534 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf62cf8-2ac7-4dc9-8358-8fef090530ad None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:05.957305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 193/396] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:05 2022] PUT /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1/groups/ed976fadbfdc4d50bc3c063490f1c9ad/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:44:06.026370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b75701-a453-4fb2-aeb0-f9dfe689d1c8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:06.079288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69871a6-5053-4ed8-90c1-8e9f9a3dea1a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.079288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69871a6-5053-4ed8-90c1-8e9f9a3dea1a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.079561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69871a6-5053-4ed8-90c1-8e9f9a3dea1a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.081018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 194/397] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:06.090096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51060ea-c11b-43b1-8a57-69571a6d9be2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.090939 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51060ea-c11b-43b1-8a57-69571a6d9be2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.090939 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51060ea-c11b-43b1-8a57-69571a6d9be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.130669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e51060ea-c11b-43b1-8a57-69571a6d9be2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:06.131865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e51060ea-c11b-43b1-8a57-69571a6d9be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:06.171307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b75701-a453-4fb2-aeb0-f9dfe689d1c8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:06.221561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404af3-c596-4bc4-bf76-423a266ef325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:06.223324 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404af3-c596-4bc4-bf76-423a266ef325 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.224148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404af3-c596-4bc4-bf76-423a266ef325 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.224653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404af3-c596-4bc4-bf76-423a266ef325 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.239914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10404af3-c596-4bc4-bf76-423a266ef325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:06.244012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 195/398] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-10404af3-c596-4bc4-bf76-423a266ef325 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:06.245978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:06.246879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:06.247674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 204/399] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:06.254191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51060ea-c11b-43b1-8a57-69571a6d9be2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:06.281000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:06.362302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51060ea-c11b-43b1-8a57-69571a6d9be2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:06.398261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1271d44-95d4-4ad4-a76f-bfa4735349fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:06.398810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1271d44-95d4-4ad4-a76f-bfa4735349fb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.399080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1271d44-95d4-4ad4-a76f-bfa4735349fb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.399351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1271d44-95d4-4ad4-a76f-bfa4735349fb None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.400019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1271d44-95d4-4ad4-a76f-bfa4735349fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:06.400317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1271d44-95d4-4ad4-a76f-bfa4735349fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:06.401709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1271d44-95d4-4ad4-a76f-bfa4735349fb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:06.411598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 196/400] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:06.417257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404af3-c596-4bc4-bf76-423a266ef325 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:06.421886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:06.480904 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e618f-fa73-45ad-8d26-2a3e8ad70430 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.481210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e618f-fa73-45ad-8d26-2a3e8ad70430 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.481453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e618f-fa73-45ad-8d26-2a3e8ad70430 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.483058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 197/401] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:06.489417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470da64-755e-4780-9018-93acfde317c6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.489729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470da64-755e-4780-9018-93acfde317c6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.489999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470da64-755e-4780-9018-93acfde317c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.530528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9470da64-755e-4780-9018-93acfde317c6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:06.530936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404af3-c596-4bc4-bf76-423a266ef325 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:06.531713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9470da64-755e-4780-9018-93acfde317c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:06.570351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d460b-eb65-41a2-a627-2b7bd9075971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:06.571483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d460b-eb65-41a2-a627-2b7bd9075971 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.571764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d460b-eb65-41a2-a627-2b7bd9075971 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.572041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d460b-eb65-41a2-a627-2b7bd9075971 None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.573181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d460b-eb65-41a2-a627-2b7bd9075971 None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:06.574907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d460b-eb65-41a2-a627-2b7bd9075971 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:06.576894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 205/402] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:06 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:06.583344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d460b-eb65-41a2-a627-2b7bd9075971 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:06.671689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:06.675246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 198/403] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:06.676116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470da64-755e-4780-9018-93acfde317c6 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:06.704946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d460b-eb65-41a2-a627-2b7bd9075971 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:06.707820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:06.750453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b968e8-c88b-40d4-98c9-437d34280b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:06.751101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b968e8-c88b-40d4-98c9-437d34280b96 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.751377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b968e8-c88b-40d4-98c9-437d34280b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.751649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b968e8-c88b-40d4-98c9-437d34280b96 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.752808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b968e8-c88b-40d4-98c9-437d34280b96 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:06.755198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b968e8-c88b-40d4-98c9-437d34280b96 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:06.757345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 206/404] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:06 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:06.763193 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b968e8-c88b-40d4-98c9-437d34280b96 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:06.883096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b968e8-c88b-40d4-98c9-437d34280b96 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:06.924334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470da64-755e-4780-9018-93acfde317c6 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:06.924808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545789d-2ff8-493d-abf9-f82d9ddedc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:06.925449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545789d-2ff8-493d-abf9-f82d9ddedc45 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.925753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545789d-2ff8-493d-abf9-f82d9ddedc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.926181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545789d-2ff8-493d-abf9-f82d9ddedc45 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf/groups/ed976fadbfdc4d50bc3c063490f1c9ad/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.928345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545789d-2ff8-493d-abf9-f82d9ddedc45 None admin] RBAC: Authorizing `identity:create_grant(project_id=97d4b1bf1bff4d36a820888731015eaf, group_id=ed976fadbfdc4d50bc3c063490f1c9ad, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:06.929906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545789d-2ff8-493d-abf9-f82d9ddedc45 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:06.971386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ceb39-c108-4548-8fa6-1bce2931dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:06.975527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ceb39-c108-4548-8fa6-1bce2931dff4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:06.975845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ceb39-c108-4548-8fa6-1bce2931dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:06.976113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ceb39-c108-4548-8fa6-1bce2931dff4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:06.987513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ceb39-c108-4548-8fa6-1bce2931dff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-947ceb39-c108-4548-8fa6-1bce2931dff4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:06.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:06.994168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:06.994971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 199/405] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:07.000747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ceb39-c108-4548-8fa6-1bce2931dff4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:07.051165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 207/406] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:06 2022] PUT /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf/groups/ed976fadbfdc4d50bc3c063490f1c9ad/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:07.053851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:07.096896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:07.113216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545789d-2ff8-493d-abf9-f82d9ddedc45 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:07.127618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ceb39-c108-4548-8fa6-1bce2931dff4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:07.172376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b825612-fe23-4e97-90fa-31cf52f4392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:07.173001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b825612-fe23-4e97-90fa-31cf52f4392c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:07.173278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b825612-fe23-4e97-90fa-31cf52f4392c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:07.173649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b825612-fe23-4e97-90fa-31cf52f4392c None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:07.174332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b825612-fe23-4e97-90fa-31cf52f4392c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:07.174689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b825612-fe23-4e97-90fa-31cf52f4392c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:07.176305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b825612-fe23-4e97-90fa-31cf52f4392c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:07.187325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 200/407] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:07.194620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b825612-fe23-4e97-90fa-31cf52f4392c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:07.312476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b825612-fe23-4e97-90fa-31cf52f4392c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:07.340264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545789d-2ff8-493d-abf9-f82d9ddedc45 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:07.351865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3e366-8f0f-461c-b78d-6b46fb72a8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:07.362009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3e366-8f0f-461c-b78d-6b46fb72a8eb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:07.362009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3e366-8f0f-461c-b78d-6b46fb72a8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:07.362009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3e366-8f0f-461c-b78d-6b46fb72a8eb None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:07.362009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3e366-8f0f-461c-b78d-6b46fb72a8eb None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:07.362009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3e366-8f0f-461c-b78d-6b46fb72a8eb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:07.362009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 201/408] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:07 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:07.366624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3e366-8f0f-461c-b78d-6b46fb72a8eb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:07.370514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:07.386487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05662c3-7852-46cf-90af-654a246fa9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:07.387511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05662c3-7852-46cf-90af-654a246fa9ac None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:07.388021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05662c3-7852-46cf-90af-654a246fa9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:07.388481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05662c3-7852-46cf-90af-654a246fa9ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:07.401171 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05662c3-7852-46cf-90af-654a246fa9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b05662c3-7852-46cf-90af-654a246fa9ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:07.408400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:07.411169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:07.412285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:07.413849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 208/409] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:07.419523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05662c3-7852-46cf-90af-654a246fa9ac None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:07.493340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3e366-8f0f-461c-b78d-6b46fb72a8eb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:07.529288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fea03e-4e64-40dc-8ccf-60d86be7ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:07.529994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fea03e-4e64-40dc-8ccf-60d86be7ca2e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:07.530278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fea03e-4e64-40dc-8ccf-60d86be7ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:07.530552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fea03e-4e64-40dc-8ccf-60d86be7ca2e None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:07.531713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fea03e-4e64-40dc-8ccf-60d86be7ca2e None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:07.533142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fea03e-4e64-40dc-8ccf-60d86be7ca2e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:07.535653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 202/410] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:07 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:07.542385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fea03e-4e64-40dc-8ccf-60d86be7ca2e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:07.634013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:07.640488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:07.662328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fea03e-4e64-40dc-8ccf-60d86be7ca2e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:07.702980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016e74c-71e5-4056-a4c7-6c7e0677c8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:07.703774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e74c-71e5-4056-a4c7-6c7e0677c8d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:07.704499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e74c-71e5-4056-a4c7-6c7e0677c8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:07.704782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016e74c-71e5-4056-a4c7-6c7e0677c8d2 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf/groups/ed976fadbfdc4d50bc3c063490f1c9ad/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:07.707656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016e74c-71e5-4056-a4c7-6c7e0677c8d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=97d4b1bf1bff4d36a820888731015eaf, group_id=ed976fadbfdc4d50bc3c063490f1c9ad, role_id=6a99e3ee2e8546c8a6cc6f4e33997bfd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:07.709097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016e74c-71e5-4056-a4c7-6c7e0677c8d2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:07.745397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05662c3-7852-46cf-90af-654a246fa9ac None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:07.783069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845781f5-6059-44cf-9cdc-39014ad94ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:07.783689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845781f5-6059-44cf-9cdc-39014ad94ddf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:07.784010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845781f5-6059-44cf-9cdc-39014ad94ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:07.784287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845781f5-6059-44cf-9cdc-39014ad94ddf None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:07.785293 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845781f5-6059-44cf-9cdc-39014ad94ddf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:07.785631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845781f5-6059-44cf-9cdc-39014ad94ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:07.787274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845781f5-6059-44cf-9cdc-39014ad94ddf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:07.801600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 209/411] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:07.801600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4ae1-3896-4d33-93f1-d8e9ad91bb36 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:07.801600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4ae1-3896-4d33-93f1-d8e9ad91bb36 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:07.801600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4ae1-3896-4d33-93f1-d8e9ad91bb36 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:07.801600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 210/412] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:07.809403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 203/413] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:07 2022] PUT /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf/groups/ed976fadbfdc4d50bc3c063490f1c9ad/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:07.809677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f4ae1-3896-4d33-93f1-d8e9ad91bb36 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:07.809766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca3ba-bb8e-42ea-8869-2e65355d94a2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:07.809766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca3ba-bb8e-42ea-8869-2e65355d94a2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:07.809766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dca3ba-bb8e-42ea-8869-2e65355d94a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:07.832055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-84dca3ba-bb8e-42ea-8869-2e65355d94a2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:07.833302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-84dca3ba-bb8e-42ea-8869-2e65355d94a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:07.927826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 204/414] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:07.959427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f4ae1-3896-4d33-93f1-d8e9ad91bb36 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:08.000639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:08.012770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bed4c5-1db0-4b91-ae4b-8b1aa2fff0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:08.013397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bed4c5-1db0-4b91-ae4b-8b1aa2fff0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:08.013701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bed4c5-1db0-4b91-ae4b-8b1aa2fff0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:08.014905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bed4c5-1db0-4b91-ae4b-8b1aa2fff0d0 None admin] PATH_INFO: `/v3/groups/b3925bcaacb54693848c2c6dc9289dcb` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:08.015101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bed4c5-1db0-4b91-ae4b-8b1aa2fff0d0 None admin] RBAC: Authorizing `identity:get_group(group_id=b3925bcaacb54693848c2c6dc9289dcb)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:08.016672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bed4c5-1db0-4b91-ae4b-8b1aa2fff0d0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:08.018595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 211/415] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:07 2022] GET /identity/v3/groups/b3925bcaacb54693848c2c6dc9289dcb => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:08.024690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca3ba-bb8e-42ea-8869-2e65355d94a2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:08.092463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:08.134959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dca3ba-bb8e-42ea-8869-2e65355d94a2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:08.180909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1903cc-f5cf-4d7b-9d72-3b27869a57eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:08.181586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1903cc-f5cf-4d7b-9d72-3b27869a57eb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:08.181865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1903cc-f5cf-4d7b-9d72-3b27869a57eb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:08.182134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1903cc-f5cf-4d7b-9d72-3b27869a57eb None admin] PATH_INFO: `/v3/projects/28aa92351f744eeb9273dbf7547e3314` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:08.183282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1903cc-f5cf-4d7b-9d72-3b27869a57eb None admin] RBAC: Authorizing `identity:get_project(project_id=28aa92351f744eeb9273dbf7547e3314)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:08.184696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1903cc-f5cf-4d7b-9d72-3b27869a57eb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:08.186565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 205/416] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:08 2022] GET /identity/v3/projects/28aa92351f744eeb9273dbf7547e3314 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:08.192660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bed4c5-1db0-4b91-ae4b-8b1aa2fff0d0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:08.279757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1903cc-f5cf-4d7b-9d72-3b27869a57eb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:08.335580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bed4c5-1db0-4b91-ae4b-8b1aa2fff0d0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:08.372505 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567571a-cfa4-419b-98dc-0c714501a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:08.373202 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567571a-cfa4-419b-98dc-0c714501a159 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:08.373589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567571a-cfa4-419b-98dc-0c714501a159 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:08.373868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567571a-cfa4-419b-98dc-0c714501a159 None admin] PATH_INFO: `/v3/projects/28aa92351f744eeb9273dbf7547e3314/groups/b3925bcaacb54693848c2c6dc9289dcb/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:08.376368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567571a-cfa4-419b-98dc-0c714501a159 None admin] RBAC: Authorizing `identity:create_grant(project_id=28aa92351f744eeb9273dbf7547e3314, group_id=b3925bcaacb54693848c2c6dc9289dcb, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:08.378046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567571a-cfa4-419b-98dc-0c714501a159 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:08.430520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1903cc-f5cf-4d7b-9d72-3b27869a57eb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:08.461518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 212/417] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 07:44:08 2022] PUT /identity/v3/projects/28aa92351f744eeb9273dbf7547e3314/groups/b3925bcaacb54693848c2c6dc9289dcb/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:44:08.471459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:08.479715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f4629-9af0-4420-9656-1c75c4d89ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:08.480699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f4629-9af0-4420-9656-1c75c4d89ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:08.481178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f4629-9af0-4420-9656-1c75c4d89ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:08.481709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f4629-9af0-4420-9656-1c75c4d89ee2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:08.495079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f4629-9af0-4420-9656-1c75c4d89ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1f5f4629-9af0-4420-9656-1c75c4d89ee2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:08.500795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:08.502125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:08.502961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:08.506292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 206/418] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:08.513561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567571a-cfa4-419b-98dc-0c714501a159 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:08.610888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:08.667992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d3f0a-88fe-43c1-a410-e721a93e4a3c None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:08.668307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d3f0a-88fe-43c1-a410-e721a93e4a3c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:08.668547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d3f0a-88fe-43c1-a410-e721a93e4a3c None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:08.670498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 207/419] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:08.684225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797ee37-08c0-48c8-aa99-1790e266229f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:08.684504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797ee37-08c0-48c8-aa99-1790e266229f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:08.684778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797ee37-08c0-48c8-aa99-1790e266229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:08.687850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567571a-cfa4-419b-98dc-0c714501a159 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:08.717762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a797ee37-08c0-48c8-aa99-1790e266229f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:08.718967 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a797ee37-08c0-48c8-aa99-1790e266229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:08.731758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cef4f-515f-41c6-a1a4-f490dadff01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:08.733004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cef4f-515f-41c6-a1a4-f490dadff01f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:08.733756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cef4f-515f-41c6-a1a4-f490dadff01f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:08.734230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cef4f-515f-41c6-a1a4-f490dadff01f None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:08.735252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cef4f-515f-41c6-a1a4-f490dadff01f None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:08.735743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cef4f-515f-41c6-a1a4-f490dadff01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:08.738494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cef4f-515f-41c6-a1a4-f490dadff01f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:08.749403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 213/420] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:08.758732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cef4f-515f-41c6-a1a4-f490dadff01f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:08.805494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 208/421] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:08.866446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cef4f-515f-41c6-a1a4-f490dadff01f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:08.880079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:08.902725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4c9a5-3ba8-47bf-a552-9b1b13db7334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:08.903332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c9a5-3ba8-47bf-a552-9b1b13db7334 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:08.903611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c9a5-3ba8-47bf-a552-9b1b13db7334 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:08.903933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c9a5-3ba8-47bf-a552-9b1b13db7334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:08.987203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4c9a5-3ba8-47bf-a552-9b1b13db7334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:08.989521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4c9a5-3ba8-47bf-a552-9b1b13db7334 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:09.112275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 214/422] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:09.118437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797ee37-08c0-48c8-aa99-1790e266229f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:09.217852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4c9a5-3ba8-47bf-a552-9b1b13db7334 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:09.230074 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797ee37-08c0-48c8-aa99-1790e266229f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:09.245830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:09.254385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:09.269779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0566d44-8fb1-421b-80cb-58c7ee514746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:09.281627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0566d44-8fb1-421b-80cb-58c7ee514746 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:09.281627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0566d44-8fb1-421b-80cb-58c7ee514746 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:09.281627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0566d44-8fb1-421b-80cb-58c7ee514746 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:09.281627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0566d44-8fb1-421b-80cb-58c7ee514746 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:09.281627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0566d44-8fb1-421b-80cb-58c7ee514746 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:09.281627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 209/423] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:09 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:09.283639 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0566d44-8fb1-421b-80cb-58c7ee514746 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:09.406581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0566d44-8fb1-421b-80cb-58c7ee514746 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:09.446088 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789fbd-ea7a-4e0a-80a4-6b00005653ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:09.446977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789fbd-ea7a-4e0a-80a4-6b00005653ca None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:09.447401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789fbd-ea7a-4e0a-80a4-6b00005653ca None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:09.447818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789fbd-ea7a-4e0a-80a4-6b00005653ca None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:09.449086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0789fbd-ea7a-4e0a-80a4-6b00005653ca None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:09.451032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0789fbd-ea7a-4e0a-80a4-6b00005653ca None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:09.453291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 210/424] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:09 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:09.459011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789fbd-ea7a-4e0a-80a4-6b00005653ca None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:09.476606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4c9a5-3ba8-47bf-a552-9b1b13db7334 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:09.520860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:09.562754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56345ede-e1a5-4558-abd5-b215f7033a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:09.563382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345ede-e1a5-4558-abd5-b215f7033a3b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:09.563635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345ede-e1a5-4558-abd5-b215f7033a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:09.563905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56345ede-e1a5-4558-abd5-b215f7033a3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:09.569628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789fbd-ea7a-4e0a-80a4-6b00005653ca None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:09.575448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56345ede-e1a5-4558-abd5-b215f7033a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-56345ede-e1a5-4558-abd5-b215f7033a3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:09.580257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:09.581155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:09.582526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:09.587916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 215/425] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:09.589259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df146c-58af-4687-88ac-013616d9346c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:09.589576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df146c-58af-4687-88ac-013616d9346c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:09.589849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df146c-58af-4687-88ac-013616d9346c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:09.591133 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 216/426] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:09.591818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df146c-58af-4687-88ac-013616d9346c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:09.614032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ccc3-962d-4600-9786-2f2446bb37e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:09.614986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ccc3-962d-4600-9786-2f2446bb37e4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:09.615482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ccc3-962d-4600-9786-2f2446bb37e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:09.615924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ccc3-962d-4600-9786-2f2446bb37e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:09.616875 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724ccc3-962d-4600-9786-2f2446bb37e4 None admin] RBAC: Adding query filter params (group.id=ed976fadbfdc4d50bc3c063490f1c9ad, role.id=a9232505007a45c580ef9414aee94847, scope.project.id=b5171171f9c44ffe896d40e40391d4a1) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:09.617389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724ccc3-962d-4600-9786-2f2446bb37e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:09.619038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724ccc3-962d-4600-9786-2f2446bb37e4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:09.625919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 211/427] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:09 2022] GET /identity/v3/role_assignments?group.id=ed976fadbfdc4d50bc3c063490f1c9ad&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=a9232505007a45c580ef9414aee94847 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:09.627414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f73337-0ec7-4352-bd45-df08928493b2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:09.627854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f73337-0ec7-4352-bd45-df08928493b2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:09.628398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f73337-0ec7-4352-bd45-df08928493b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:09.648692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-55f73337-0ec7-4352-bd45-df08928493b2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:09.650279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-55f73337-0ec7-4352-bd45-df08928493b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:09.680513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:09.708506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df146c-58af-4687-88ac-013616d9346c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:09.747129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 212/428] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:09.758391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e8fa3-7bab-423b-94ee-d0666afa2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:09.759391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e8fa3-7bab-423b-94ee-d0666afa2d2e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:09.759897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e8fa3-7bab-423b-94ee-d0666afa2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:09.760371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e8fa3-7bab-423b-94ee-d0666afa2d2e None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:09.761268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e8fa3-7bab-423b-94ee-d0666afa2d2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:09.761803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e8fa3-7bab-423b-94ee-d0666afa2d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:09.763435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e8fa3-7bab-423b-94ee-d0666afa2d2e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:09.786378 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 217/429] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:09.792688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f73337-0ec7-4352-bd45-df08928493b2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:09.861867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:09.909148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f73337-0ec7-4352-bd45-df08928493b2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:09.949128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f75d3-5bac-436f-bd83-a6af1697145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:09.949692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f75d3-5bac-436f-bd83-a6af1697145a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:09.949974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f75d3-5bac-436f-bd83-a6af1697145a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:09.950241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f75d3-5bac-436f-bd83-a6af1697145a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.024294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f75d3-5bac-436f-bd83-a6af1697145a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:10.025783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f75d3-5bac-436f-bd83-a6af1697145a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:10.049057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e8fa3-7bab-423b-94ee-d0666afa2d2e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.089873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.137564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 213/430] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:10.151034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f75d3-5bac-436f-bd83-a6af1697145a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.180665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e8fa3-7bab-423b-94ee-d0666afa2d2e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.230594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b48a27-9d72-486a-b09a-c78a3c7b2c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.231312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48a27-9d72-486a-b09a-c78a3c7b2c22 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.231691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48a27-9d72-486a-b09a-c78a3c7b2c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.232063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b48a27-9d72-486a-b09a-c78a3c7b2c22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.235019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.248997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b48a27-9d72-486a-b09a-c78a3c7b2c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-75b48a27-9d72-486a-b09a-c78a3c7b2c22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:10.255174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:10.256350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:44:10.257402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:10.258890 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 218/431] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:10.260079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84051e2-4764-4723-b863-936b9c34dacd None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.260485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84051e2-4764-4723-b863-936b9c34dacd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.260762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84051e2-4764-4723-b863-936b9c34dacd None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.262074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 219/432] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:10.267011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84051e2-4764-4723-b863-936b9c34dacd None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.297669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f75d3-5bac-436f-bd83-a6af1697145a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.348245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268860f-c667-49fb-8fd3-591f8646e367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.348784 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268860f-c667-49fb-8fd3-591f8646e367 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.349085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268860f-c667-49fb-8fd3-591f8646e367 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.349348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268860f-c667-49fb-8fd3-591f8646e367 None admin] PATH_INFO: `/v3/projects/b5171171f9c44ffe896d40e40391d4a1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.352593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268860f-c667-49fb-8fd3-591f8646e367 None admin] RBAC: Authorizing `identity:get_project(project_id=b5171171f9c44ffe896d40e40391d4a1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:10.354281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268860f-c667-49fb-8fd3-591f8646e367 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:10.355783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 214/433] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/projects/b5171171f9c44ffe896d40e40391d4a1 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:10.356933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef0c50-07b7-401d-a70d-bd1007d86271 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.357186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef0c50-07b7-401d-a70d-bd1007d86271 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.357456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef0c50-07b7-401d-a70d-bd1007d86271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.383275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f2ef0c50-07b7-401d-a70d-bd1007d86271 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:10.384471 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f2ef0c50-07b7-401d-a70d-bd1007d86271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:10.400638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.412745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84051e2-4764-4723-b863-936b9c34dacd None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.451919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97fc72-fd2b-4cd7-8629-2091f6e0eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.452510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97fc72-fd2b-4cd7-8629-2091f6e0eb6f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.452822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97fc72-fd2b-4cd7-8629-2091f6e0eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.453051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97fc72-fd2b-4cd7-8629-2091f6e0eb6f None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.453737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97fc72-fd2b-4cd7-8629-2091f6e0eb6f None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:10.454036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97fc72-fd2b-4cd7-8629-2091f6e0eb6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:10.455405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97fc72-fd2b-4cd7-8629-2091f6e0eb6f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:10.468967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 220/434] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:10.468967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97fc72-fd2b-4cd7-8629-2091f6e0eb6f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.473348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 215/435] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:10.474031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef0c50-07b7-401d-a70d-bd1007d86271 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.535475 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.583759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97fc72-fd2b-4cd7-8629-2091f6e0eb6f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.611273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef0c50-07b7-401d-a70d-bd1007d86271 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.625872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bade3a-1b5a-43c8-9fc2-8d85043b125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.627268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bade3a-1b5a-43c8-9fc2-8d85043b125f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.627990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bade3a-1b5a-43c8-9fc2-8d85043b125f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.628978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bade3a-1b5a-43c8-9fc2-8d85043b125f None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.631029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bade3a-1b5a-43c8-9fc2-8d85043b125f None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:10.632678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bade3a-1b5a-43c8-9fc2-8d85043b125f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:10.640024 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 221/436] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:10.641211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bade3a-1b5a-43c8-9fc2-8d85043b125f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.651177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb626e5-bf5a-4c57-b69a-ccc9e8f93c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.652126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb626e5-bf5a-4c57-b69a-ccc9e8f93c51 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.652608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb626e5-bf5a-4c57-b69a-ccc9e8f93c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.653399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb626e5-bf5a-4c57-b69a-ccc9e8f93c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.677427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.740976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb626e5-bf5a-4c57-b69a-ccc9e8f93c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:10.742714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb626e5-bf5a-4c57-b69a-ccc9e8f93c51 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:10.750885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bade3a-1b5a-43c8-9fc2-8d85043b125f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.777657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.789917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd3056-1356-47ba-bd90-71da73f79254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.790459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd3056-1356-47ba-bd90-71da73f79254 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.790725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd3056-1356-47ba-bd90-71da73f79254 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.791057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd3056-1356-47ba-bd90-71da73f79254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:10.791798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd3056-1356-47ba-bd90-71da73f79254 None admin] RBAC: Adding query filter params (group.id=ed976fadbfdc4d50bc3c063490f1c9ad, role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=b5171171f9c44ffe896d40e40391d4a1) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:10.792104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd3056-1356-47ba-bd90-71da73f79254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:10.793567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd3056-1356-47ba-bd90-71da73f79254 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:10.799448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 222/437] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/role_assignments?group.id=ed976fadbfdc4d50bc3c063490f1c9ad&scope.project.id=b5171171f9c44ffe896d40e40391d4a1&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:10.801050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd3056-1356-47ba-bd90-71da73f79254 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.875354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 216/438] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:10.883684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb626e5-bf5a-4c57-b69a-ccc9e8f93c51 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:10.936289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd3056-1356-47ba-bd90-71da73f79254 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:10.955671 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.985064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ada5a7-2ebf-4654-af69-62f981cfed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:10.986800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ada5a7-2ebf-4654-af69-62f981cfed86 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:10.987241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ada5a7-2ebf-4654-af69-62f981cfed86 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:10.987746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ada5a7-2ebf-4654-af69-62f981cfed86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.001029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ada5a7-2ebf-4654-af69-62f981cfed86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-73ada5a7-2ebf-4654-af69-62f981cfed86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:11.006805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:11.007702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 223/439] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:11.014297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5965-c787-4c34-b2a2-1575ade819d4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.015014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5965-c787-4c34-b2a2-1575ade819d4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.015014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e5965-c787-4c34-b2a2-1575ade819d4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.015014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 224/440] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:11.016938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e5965-c787-4c34-b2a2-1575ade819d4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.020087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb626e5-bf5a-4c57-b69a-ccc9e8f93c51 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.070364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f8662-7623-4b2e-a5f1-831fa3ca5aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.070751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8662-7623-4b2e-a5f1-831fa3ca5aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.071028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8662-7623-4b2e-a5f1-831fa3ca5aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.071610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f8662-7623-4b2e-a5f1-831fa3ca5aa2 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.074851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f8662-7623-4b2e-a5f1-831fa3ca5aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.080715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f8662-7623-4b2e-a5f1-831fa3ca5aa2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.081004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.084191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 217/441] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:10 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:11.085652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168f76-e339-4de2-b09c-97afe17e988c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.085933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168f76-e339-4de2-b09c-97afe17e988c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.086205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168f76-e339-4de2-b09c-97afe17e988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.105689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-29168f76-e339-4de2-b09c-97afe17e988c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:11.106791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-29168f76-e339-4de2-b09c-97afe17e988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:11.147342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e5965-c787-4c34-b2a2-1575ade819d4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.188042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 218/442] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:11.188556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97612c9-fdfc-49d0-90ef-bd55ca3de754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.189732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168f76-e339-4de2-b09c-97afe17e988c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.189852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97612c9-fdfc-49d0-90ef-bd55ca3de754 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.190080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97612c9-fdfc-49d0-90ef-bd55ca3de754 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.190356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97612c9-fdfc-49d0-90ef-bd55ca3de754 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.192220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97612c9-fdfc-49d0-90ef-bd55ca3de754 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:11.192529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97612c9-fdfc-49d0-90ef-bd55ca3de754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.194150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97612c9-fdfc-49d0-90ef-bd55ca3de754 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.205846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 225/443] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:11.209425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97612c9-fdfc-49d0-90ef-bd55ca3de754 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.248324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.304953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168f76-e339-4de2-b09c-97afe17e988c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.325720 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97612c9-fdfc-49d0-90ef-bd55ca3de754 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.340779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.344072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9baf086-c703-4de5-9704-39a796a9be3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.344859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9baf086-c703-4de5-9704-39a796a9be3e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.345231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9baf086-c703-4de5-9704-39a796a9be3e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.345709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9baf086-c703-4de5-9704-39a796a9be3e None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.347482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9baf086-c703-4de5-9704-39a796a9be3e None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.349015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9baf086-c703-4de5-9704-39a796a9be3e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.350749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 219/444] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:11.356538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9baf086-c703-4de5-9704-39a796a9be3e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.369439 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33007848-730d-451e-88e5-a9ad4bc1f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.370047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33007848-730d-451e-88e5-a9ad4bc1f771 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.370494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33007848-730d-451e-88e5-a9ad4bc1f771 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.370720 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33007848-730d-451e-88e5-a9ad4bc1f771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.451031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33007848-730d-451e-88e5-a9ad4bc1f771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.452634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33007848-730d-451e-88e5-a9ad4bc1f771 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.471051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9baf086-c703-4de5-9704-39a796a9be3e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.484743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.505648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d74f0-b73e-4bce-9010-16d91324d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.506386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d74f0-b73e-4bce-9010-16d91324d804 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.506656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d74f0-b73e-4bce-9010-16d91324d804 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.506921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d74f0-b73e-4bce-9010-16d91324d804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.507633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d74f0-b73e-4bce-9010-16d91324d804 None admin] RBAC: Adding query filter params (group.id=ed976fadbfdc4d50bc3c063490f1c9ad, role.id=a9232505007a45c580ef9414aee94847, scope.project.id=97d4b1bf1bff4d36a820888731015eaf) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:11.507937 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d74f0-b73e-4bce-9010-16d91324d804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.509335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d74f0-b73e-4bce-9010-16d91324d804 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.515151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 220/445] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/role_assignments?group.id=ed976fadbfdc4d50bc3c063490f1c9ad&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=a9232505007a45c580ef9414aee94847 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:11.515837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d74f0-b73e-4bce-9010-16d91324d804 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.561503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 226/446] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:11.568003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33007848-730d-451e-88e5-a9ad4bc1f771 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.580653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.631378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d74f0-b73e-4bce-9010-16d91324d804 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.677712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e8a8-c0c9-4c7f-bf03-87b49a91eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.678522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e8a8-c0c9-4c7f-bf03-87b49a91eb2c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.678806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e8a8-c0c9-4c7f-bf03-87b49a91eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.679081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e8a8-c0c9-4c7f-bf03-87b49a91eb2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.687123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33007848-730d-451e-88e5-a9ad4bc1f771 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.695234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01e8a8-c0c9-4c7f-bf03-87b49a91eb2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-fa01e8a8-c0c9-4c7f-bf03-87b49a91eb2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:11.702207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:11.703315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:11.704286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 221/447] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:11.711166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e8a8-c0c9-4c7f-bf03-87b49a91eb2c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.732302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633a17e-b49f-491b-9347-c157a8427c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.733049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633a17e-b49f-491b-9347-c157a8427c68 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.733326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633a17e-b49f-491b-9347-c157a8427c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.733612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633a17e-b49f-491b-9347-c157a8427c68 None admin] PATH_INFO: `/v3/projects/97d4b1bf1bff4d36a820888731015eaf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.736612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633a17e-b49f-491b-9347-c157a8427c68 None admin] RBAC: Authorizing `identity:get_project(project_id=97d4b1bf1bff4d36a820888731015eaf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.736612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633a17e-b49f-491b-9347-c157a8427c68 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.738608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 227/448] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/projects/97d4b1bf1bff4d36a820888731015eaf => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:11.744447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633a17e-b49f-491b-9347-c157a8427c68 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.764908 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.837858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.840528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e8a8-c0c9-4c7f-bf03-87b49a91eb2c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.864161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633a17e-b49f-491b-9347-c157a8427c68 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:11.879797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c5874-e8b8-45d1-b2a3-320c88a31744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.880411 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c5874-e8b8-45d1-b2a3-320c88a31744 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.880687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c5874-e8b8-45d1-b2a3-320c88a31744 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.880958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c5874-e8b8-45d1-b2a3-320c88a31744 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.881651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c5874-e8b8-45d1-b2a3-320c88a31744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:11.881953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c5874-e8b8-45d1-b2a3-320c88a31744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.883324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c5874-e8b8-45d1-b2a3-320c88a31744 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.891565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 222/449] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:11.897019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c5874-e8b8-45d1-b2a3-320c88a31744 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.903985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f34ea-0980-4084-800f-038a7e62d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:11.904603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f34ea-0980-4084-800f-038a7e62d6eb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:11.904873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f34ea-0980-4084-800f-038a7e62d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:11.905138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f34ea-0980-4084-800f-038a7e62d6eb None admin] PATH_INFO: `/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:11.906679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f34ea-0980-4084-800f-038a7e62d6eb None admin] RBAC: Authorizing `identity:get_group(group_id=ed976fadbfdc4d50bc3c063490f1c9ad)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:11.908113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f34ea-0980-4084-800f-038a7e62d6eb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:11.910251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 228/450] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/groups/ed976fadbfdc4d50bc3c063490f1c9ad => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:11.916212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f34ea-0980-4084-800f-038a7e62d6eb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:11.993263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:11.996024 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c5874-e8b8-45d1-b2a3-320c88a31744 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.014132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f34ea-0980-4084-800f-038a7e62d6eb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.035911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c6c18-0278-4496-8e60-68c1dd74aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.036509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c6c18-0278-4496-8e60-68c1dd74aae4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.037049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c6c18-0278-4496-8e60-68c1dd74aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.037318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c6c18-0278-4496-8e60-68c1dd74aae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.048409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f17e1-0631-48d2-ac95-7677f2389ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.049012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f17e1-0631-48d2-ac95-7677f2389ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.049284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f17e1-0631-48d2-ac95-7677f2389ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.049581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f17e1-0631-48d2-ac95-7677f2389ae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.051011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f17e1-0631-48d2-ac95-7677f2389ae3 None admin] RBAC: Adding query filter params (group.id=ed976fadbfdc4d50bc3c063490f1c9ad, role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=97d4b1bf1bff4d36a820888731015eaf) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:12.051315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f17e1-0631-48d2-ac95-7677f2389ae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.052736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f17e1-0631-48d2-ac95-7677f2389ae3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.058412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 229/451] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/role_assignments?group.id=ed976fadbfdc4d50bc3c063490f1c9ad&scope.project.id=97d4b1bf1bff4d36a820888731015eaf&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.107795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c6c18-0278-4496-8e60-68c1dd74aae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.109210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c6c18-0278-4496-8e60-68c1dd74aae4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.208563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.212142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 223/452] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:12.217883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f17e1-0631-48d2-ac95-7677f2389ae3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.231463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.323287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f17e1-0631-48d2-ac95-7677f2389ae3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.358887 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d277a01-4f3f-45d8-a8bb-ee7420a9380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.359494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d277a01-4f3f-45d8-a8bb-ee7420a9380e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.359720 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d277a01-4f3f-45d8-a8bb-ee7420a9380e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.359955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d277a01-4f3f-45d8-a8bb-ee7420a9380e None admin] PATH_INFO: `/v3/projects/28aa92351f744eeb9273dbf7547e3314` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.361079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d277a01-4f3f-45d8-a8bb-ee7420a9380e None admin] RBAC: Authorizing `identity:get_project(project_id=28aa92351f744eeb9273dbf7547e3314)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.362691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d277a01-4f3f-45d8-a8bb-ee7420a9380e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.364679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 230/453] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/projects/28aa92351f744eeb9273dbf7547e3314 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.370529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c6c18-0278-4496-8e60-68c1dd74aae4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.475916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c6c18-0278-4496-8e60-68c1dd74aae4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.508402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f5d1a-14f4-4a9b-b9a7-90419a4648b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.509016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5d1a-14f4-4a9b-b9a7-90419a4648b1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.509290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5d1a-14f4-4a9b-b9a7-90419a4648b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.509588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5d1a-14f4-4a9b-b9a7-90419a4648b1 None admin] PATH_INFO: `/v3/groups/b3925bcaacb54693848c2c6dc9289dcb` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.510670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f5d1a-14f4-4a9b-b9a7-90419a4648b1 None admin] RBAC: Authorizing `identity:get_group(group_id=b3925bcaacb54693848c2c6dc9289dcb)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.512101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f5d1a-14f4-4a9b-b9a7-90419a4648b1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.513680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 224/454] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/groups/b3925bcaacb54693848c2c6dc9289dcb => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:12.520362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d277a01-4f3f-45d8-a8bb-ee7420a9380e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:12.596539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:12.617993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d277a01-4f3f-45d8-a8bb-ee7420a9380e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:12.650888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734360a-4678-4d31-a90c-003bfbb23626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:12.651473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734360a-4678-4d31-a90c-003bfbb23626 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:12.651750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734360a-4678-4d31-a90c-003bfbb23626 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:12.652019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734360a-4678-4d31-a90c-003bfbb23626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:12.652743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734360a-4678-4d31-a90c-003bfbb23626 None admin] RBAC: Adding query filter params (group.id=b3925bcaacb54693848c2c6dc9289dcb, role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=28aa92351f744eeb9273dbf7547e3314) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:12.653045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734360a-4678-4d31-a90c-003bfbb23626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:12.654492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734360a-4678-4d31-a90c-003bfbb23626 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:12.661020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 231/455] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 07:44:12 2022] GET /identity/v3/role_assignments?group.id=b3925bcaacb54693848c2c6dc9289dcb&scope.project.id=28aa92351f744eeb9273dbf7547e3314&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:14.883010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff6789-11f9-41ac-b242-c6beb6b6fcbe None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:14.883509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff6789-11f9-41ac-b242-c6beb6b6fcbe None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:14.883585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff6789-11f9-41ac-b242-c6beb6b6fcbe None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:14.884896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 225/456] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:14.890099 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5456b5-565b-411a-b792-8c36039db9bf None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:14.890583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5456b5-565b-411a-b792-8c36039db9bf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:14.890662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5456b5-565b-411a-b792-8c36039db9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:14.915082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ee5456b5-565b-411a-b792-8c36039db9bf None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:14.916281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ee5456b5-565b-411a-b792-8c36039db9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:14.999562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 232/457] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:15.328176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e64a8-b4b7-4ff5-8dd4-1c78ca2c75d5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.328548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e64a8-b4b7-4ff5-8dd4-1c78ca2c75d5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.328814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e64a8-b4b7-4ff5-8dd4-1c78ca2c75d5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.330751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 226/458] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:15.332295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5456b5-565b-411a-b792-8c36039db9bf None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:15.359605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63091d-6404-4f4d-a7ed-8906bda1ff19 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.359824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63091d-6404-4f4d-a7ed-8906bda1ff19 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.363291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63091d-6404-4f4d-a7ed-8906bda1ff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.382675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7b63091d-6404-4f4d-a7ed-8906bda1ff19 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:15.383910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7b63091d-6404-4f4d-a7ed-8906bda1ff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:15.457053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:15.460732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:15.466663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 227/459] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:15.473566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2443-7074-42e7-9ed2-d4a898c5edb1 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.473566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2443-7074-42e7-9ed2-d4a898c5edb1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.473566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2443-7074-42e7-9ed2-d4a898c5edb1 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.473566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 228/460] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:15.484356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde60f0-c852-4e8a-9037-fd1f228c43d2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.484731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde60f0-c852-4e8a-9037-fd1f228c43d2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.485084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde60f0-c852-4e8a-9037-fd1f228c43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.500879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5456b5-565b-411a-b792-8c36039db9bf None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:15.519121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ccde60f0-c852-4e8a-9037-fd1f228c43d2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:15.520590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ccde60f0-c852-4e8a-9037-fd1f228c43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:15.549650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb391f-e16c-4b51-85eb-d7e78695747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:15.551232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb391f-e16c-4b51-85eb-d7e78695747f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.551727 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb391f-e16c-4b51-85eb-d7e78695747f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.552289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb391f-e16c-4b51-85eb-d7e78695747f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.575832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb391f-e16c-4b51-85eb-d7e78695747f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:15.577732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb391f-e16c-4b51-85eb-d7e78695747f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-e3eb391f-e16c-4b51-85eb-d7e78695747f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:15.595513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:15.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:15.598539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:15.598539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:15.598539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:15.600401 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 233/461] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:15.608918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 229/462] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:15.609065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb391f-e16c-4b51-85eb-d7e78695747f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:15.722224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb391f-e16c-4b51-85eb-d7e78695747f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:15.760856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:15.774689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e652968-7c76-46a4-9735-e12f591353ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:15.777333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e652968-7c76-46a4-9735-e12f591353ee None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.777333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e652968-7c76-46a4-9735-e12f591353ee None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.777333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e652968-7c76-46a4-9735-e12f591353ee None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.777333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e652968-7c76-46a4-9735-e12f591353ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:15.777333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e652968-7c76-46a4-9735-e12f591353ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:15.778237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e652968-7c76-46a4-9735-e12f591353ee None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:15.779616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87196-bd72-4d8d-9be4-48fdba37c1d4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.780032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87196-bd72-4d8d-9be4-48fdba37c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.780385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87196-bd72-4d8d-9be4-48fdba37c1d4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.784014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 230/463] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:15.790499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76a67-3e4c-49e0-9cbc-dd8a51fd4a6a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.790852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76a67-3e4c-49e0-9cbc-dd8a51fd4a6a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.791199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76a67-3e4c-49e0-9cbc-dd8a51fd4a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.791301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 234/464] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:15.797253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e652968-7c76-46a4-9735-e12f591353ee None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:15.830478 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-92b76a67-3e4c-49e0-9cbc-dd8a51fd4a6a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:15.833112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-92b76a67-3e4c-49e0-9cbc-dd8a51fd4a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:15.914609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e652968-7c76-46a4-9735-e12f591353ee None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:15.929782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 231/465] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:15.931259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b76a67-3e4c-49e0-9cbc-dd8a51fd4a6a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:15.950144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec772bf7-ecbd-4fba-ae5d-daff9e03fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:15.950748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec772bf7-ecbd-4fba-ae5d-daff9e03fdcd None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:15.951022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec772bf7-ecbd-4fba-ae5d-daff9e03fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:15.951285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec772bf7-ecbd-4fba-ae5d-daff9e03fdcd None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:15.952032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec772bf7-ecbd-4fba-ae5d-daff9e03fdcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:15.953639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec772bf7-ecbd-4fba-ae5d-daff9e03fdcd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.012223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.057599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b76a67-3e4c-49e0-9cbc-dd8a51fd4a6a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.061692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 235/466] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:15 2022] POST /identity/v3/users => generated 246 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:16.062515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec772bf7-ecbd-4fba-ae5d-daff9e03fdcd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.134989 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8afe44-c1d9-4f0b-9f12-e78f97494036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.135645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8afe44-c1d9-4f0b-9f12-e78f97494036 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.135917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8afe44-c1d9-4f0b-9f12-e78f97494036 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.136179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8afe44-c1d9-4f0b-9f12-e78f97494036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.139104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.154343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8afe44-c1d9-4f0b-9f12-e78f97494036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.155829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8afe44-c1d9-4f0b-9f12-e78f97494036 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6b8afe44-c1d9-4f0b-9f12-e78f97494036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:16.182115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:16.183444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:16.184333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:16.184333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:16.184333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:16.184333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 232/467] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:16.193535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8afe44-c1d9-4f0b-9f12-e78f97494036 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.260679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec772bf7-ecbd-4fba-ae5d-daff9e03fdcd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.298774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe7bf0-1127-4f96-abf9-1576fb80e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.299412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe7bf0-1127-4f96-abf9-1576fb80e185 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.300224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe7bf0-1127-4f96-abf9-1576fb80e185 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.300731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe7bf0-1127-4f96-abf9-1576fb80e185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.312688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe7bf0-1127-4f96-abf9-1576fb80e185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.314237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe7bf0-1127-4f96-abf9-1576fb80e185 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f3fe7bf0-1127-4f96-abf9-1576fb80e185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:16.330446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:16.331457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:16.333106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:16.333106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:16.333106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:16.333106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 236/468] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:16.333106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe7bf0-1127-4f96-abf9-1576fb80e185 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.351084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8afe44-c1d9-4f0b-9f12-e78f97494036 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.366331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.395445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323e17-bcad-4688-9530-0d2d56999b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.396444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323e17-bcad-4688-9530-0d2d56999b0a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.396717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323e17-bcad-4688-9530-0d2d56999b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.396988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323e17-bcad-4688-9530-0d2d56999b0a None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.397686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323e17-bcad-4688-9530-0d2d56999b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:16.397988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323e17-bcad-4688-9530-0d2d56999b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.399351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323e17-bcad-4688-9530-0d2d56999b0a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.415075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 233/469] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:16.415775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323e17-bcad-4688-9530-0d2d56999b0a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.475001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.489444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe7bf0-1127-4f96-abf9-1576fb80e185 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.526144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed69f63-854b-4df3-b7b3-88fa2c334829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.526778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed69f63-854b-4df3-b7b3-88fa2c334829 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.528055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed69f63-854b-4df3-b7b3-88fa2c334829 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.528330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed69f63-854b-4df3-b7b3-88fa2c334829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.539337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323e17-bcad-4688-9530-0d2d56999b0a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.550954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed69f63-854b-4df3-b7b3-88fa2c334829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.552443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed69f63-854b-4df3-b7b3-88fa2c334829 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5ed69f63-854b-4df3-b7b3-88fa2c334829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:16.568907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:16.570013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:16.571070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:16.571070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:16.571070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:16.571070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 237/470] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:16.575891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed69f63-854b-4df3-b7b3-88fa2c334829 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.588133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3350a-a6f8-4258-b3d6-947f24e6064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.589354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3350a-a6f8-4258-b3d6-947f24e6064d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.590129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3350a-a6f8-4258-b3d6-947f24e6064d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.590585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3350a-a6f8-4258-b3d6-947f24e6064d None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.591412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3350a-a6f8-4258-b3d6-947f24e6064d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:16.592022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3350a-a6f8-4258-b3d6-947f24e6064d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.594259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3350a-a6f8-4258-b3d6-947f24e6064d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.610859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 234/471] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:16.612192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3350a-a6f8-4258-b3d6-947f24e6064d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.654335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.685101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed69f63-854b-4df3-b7b3-88fa2c334829 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.726567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00febfc7-d0ef-4248-a620-f646c5b483c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.727090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00febfc7-d0ef-4248-a620-f646c5b483c2 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.727364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00febfc7-d0ef-4248-a620-f646c5b483c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.727632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00febfc7-d0ef-4248-a620-f646c5b483c2 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.728683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00febfc7-d0ef-4248-a620-f646c5b483c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.729828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00febfc7-d0ef-4248-a620-f646c5b483c2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.741530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3350a-a6f8-4258-b3d6-947f24e6064d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.775309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e2250-8160-40f8-b4a2-925c294e335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.775909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e2250-8160-40f8-b4a2-925c294e335c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.776181 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e2250-8160-40f8-b4a2-925c294e335c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.776450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e2250-8160-40f8-b4a2-925c294e335c None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.777083 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e2250-8160-40f8-b4a2-925c294e335c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:16.777380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e2250-8160-40f8-b4a2-925c294e335c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.778828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e2250-8160-40f8-b4a2-925c294e335c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:16.791348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 235/472] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:16.792114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e2250-8160-40f8-b4a2-925c294e335c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.841153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.853091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 238/473] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:16 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:16.853091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0a8e-a4a6-4e1e-bf14-c6536d194e89 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.853091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0a8e-a4a6-4e1e-bf14-c6536d194e89 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.853091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce0a8e-a4a6-4e1e-bf14-c6536d194e89 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.853091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 239/474] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:16.853091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce0a8e-a4a6-4e1e-bf14-c6536d194e89 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:16.913086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:16.926903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e2250-8160-40f8-b4a2-925c294e335c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.977008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce0a8e-a4a6-4e1e-bf14-c6536d194e89 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:16.977714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2ca64-9b52-476a-9604-93412c2ea673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:16.978330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ca64-9b52-476a-9604-93412c2ea673 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:16.978601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ca64-9b52-476a-9604-93412c2ea673 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:16.978868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2ca64-9b52-476a-9604-93412c2ea673 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:16.979576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2ca64-9b52-476a-9604-93412c2ea673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:16.981205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2ca64-9b52-476a-9604-93412c2ea673 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.016644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7e3f9-5183-4746-a13f-9f5991f9631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.017370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7e3f9-5183-4746-a13f-9f5991f9631a None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.017690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7e3f9-5183-4746-a13f-9f5991f9631a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.017963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7e3f9-5183-4746-a13f-9f5991f9631a None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.019208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7e3f9-5183-4746-a13f-9f5991f9631a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.021644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7e3f9-5183-4746-a13f-9f5991f9631a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.086464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 236/475] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:16 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:17.087885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ff93-773f-4269-8cbe-4f69f9794fc9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.088237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ff93-773f-4269-8cbe-4f69f9794fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.088576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ff93-773f-4269-8cbe-4f69f9794fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.111106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ad70ff93-773f-4269-8cbe-4f69f9794fc9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:17.112555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ad70ff93-773f-4269-8cbe-4f69f9794fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:17.120418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 240/476] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:16 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:17.208535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 237/477] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:17.479649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7e3f9-5183-4746-a13f-9f5991f9631a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.546951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.610515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7e3f9-5183-4746-a13f-9f5991f9631a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.664616 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.665184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.665489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.665767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.666438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:17.667815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:17.716414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.sql.core [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:44:17.716414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 07:44:17.716414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [parameters: {'id': '871f46ddbddd4b5bbdf81ff2b97b96a8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 07:44:17.716414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81783) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result.read() Aug 24 07:44:17.733080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:44:17.734013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application yield resource Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise self.value Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application session.commit() Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:44:17.734941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:44:17.735799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:44:17.736688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result.read() Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:44:17.739669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [parameters: {'id': '871f46ddbddd4b5bbdf81ff2b97b96a8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:17.741575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 07:44:17.743601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:17.750259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 241/478] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 07:44:17 2022] POST /identity/v3/roles => generated 144 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:17.752452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70ff93-773f-4269-8cbe-4f69f9794fc9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:17.848086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:17.882247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70ff93-773f-4269-8cbe-4f69f9794fc9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:17.936594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec892c-5128-493f-a947-4c29a2098861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:17.937155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec892c-5128-493f-a947-4c29a2098861 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:17.937432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec892c-5128-493f-a947-4c29a2098861 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:17.937730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec892c-5128-493f-a947-4c29a2098861 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:17.954279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec892c-5128-493f-a947-4c29a2098861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-48ec892c-5128-493f-a947-4c29a2098861 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:17.959725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:17.960597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:17.961414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 238/479] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:17.968242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.087765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961f4fd-e327-4ccb-bdbc-e669730d7aeb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:18.108456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:18.122659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d6a72-6033-495c-88eb-940b4b37ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:18.123269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6a72-6033-495c-88eb-940b4b37ca3b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.128379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6a72-6033-495c-88eb-940b4b37ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.128379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6a72-6033-495c-88eb-940b4b37ca3b None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.128379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d6a72-6033-495c-88eb-940b4b37ca3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:18.128379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d6a72-6033-495c-88eb-940b4b37ca3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:18.128379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d6a72-6033-495c-88eb-940b4b37ca3b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:18.139621 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 242/480] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:18.344075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000627c-38aa-43d2-8810-64901a9e2992 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.344605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000627c-38aa-43d2-8810-64901a9e2992 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.344605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000627c-38aa-43d2-8810-64901a9e2992 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.345982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 239/481] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:18.351752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20866-68e3-4bd8-bcec-92e5888a56bd None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:18.352040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20866-68e3-4bd8-bcec-92e5888a56bd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:18.352318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20866-68e3-4bd8-bcec-92e5888a56bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:18.376613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-fee20866-68e3-4bd8-bcec-92e5888a56bd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:18.378735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fee20866-68e3-4bd8-bcec-92e5888a56bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:18.456394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 243/482] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:18.860402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000627c-38aa-43d2-8810-64901a9e2992 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:18.984991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000627c-38aa-43d2-8810-64901a9e2992 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:19.028006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64512a-04b6-419c-9ea0-516102a0e6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:19.029050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64512a-04b6-419c-9ea0-516102a0e6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.029658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64512a-04b6-419c-9ea0-516102a0e6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.030127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64512a-04b6-419c-9ea0-516102a0e6e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.038004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:19.044862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64512a-04b6-419c-9ea0-516102a0e6e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ca64512a-04b6-419c-9ea0-516102a0e6e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:19.049849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:19.060774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:19.061644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 240/483] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:19.062320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee20866-68e3-4bd8-bcec-92e5888a56bd None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:19.180462 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee20866-68e3-4bd8-bcec-92e5888a56bd None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:19.198004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:19.219963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99c3f3-ce28-4c03-a232-d004092cb6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:19.220632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99c3f3-ce28-4c03-a232-d004092cb6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.220954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99c3f3-ce28-4c03-a232-d004092cb6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.221234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99c3f3-ce28-4c03-a232-d004092cb6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.222308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99c3f3-ce28-4c03-a232-d004092cb6d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:19.222614 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99c3f3-ce28-4c03-a232-d004092cb6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:19.223997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99c3f3-ce28-4c03-a232-d004092cb6d4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:19.232575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 244/484] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:19.239008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64512a-04b6-419c-9ea0-516102a0e6e7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:19.387994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64512a-04b6-419c-9ea0-516102a0e6e7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:19.433553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935ac8-351b-40e8-91f8-da16a3b10dc8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.433828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935ac8-351b-40e8-91f8-da16a3b10dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.434019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7935ac8-351b-40e8-91f8-da16a3b10dc8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.435588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 245/485] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:19.439658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb03210-3980-4a32-8bc6-b7fdcb0d5a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:19.441003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e776c9-551a-4254-a9ee-496b3902b981 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.441182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb03210-3980-4a32-8bc6-b7fdcb0d5a78 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.441329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e776c9-551a-4254-a9ee-496b3902b981 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.441492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb03210-3980-4a32-8bc6-b7fdcb0d5a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.441650 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb03210-3980-4a32-8bc6-b7fdcb0d5a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.441801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e776c9-551a-4254-a9ee-496b3902b981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.457840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb03210-3980-4a32-8bc6-b7fdcb0d5a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:19.459371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb03210-3980-4a32-8bc6-b7fdcb0d5a78 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:19.460451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c2e776c9-551a-4254-a9ee-496b3902b981 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:19.461674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c2e776c9-551a-4254-a9ee-496b3902b981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-8bb03210-3980-4a32-8bc6-b7fdcb0d5a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:19.481223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:19.483096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:19.484172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:19.484172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:19.484172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:19.484172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 241/486] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:19.490311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb03210-3980-4a32-8bc6-b7fdcb0d5a78 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:19.570867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 246/487] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:19.580485 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:19.599527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e395b1-1f12-4e06-8416-2075e680e830 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.600025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e395b1-1f12-4e06-8416-2075e680e830 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.600438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e395b1-1f12-4e06-8416-2075e680e830 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.602087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 247/488] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:19.613992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad83b8-9c1d-4563-bded-2516644c1435 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.614590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad83b8-9c1d-4563-bded-2516644c1435 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.615084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad83b8-9c1d-4563-bded-2516644c1435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.644567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-92ad83b8-9c1d-4563-bded-2516644c1435 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:19.645807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-92ad83b8-9c1d-4563-bded-2516644c1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:19.666165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb03210-3980-4a32-8bc6-b7fdcb0d5a78 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:19.725851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f043ea-b61c-4b4b-be06-2d367f528ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:19.726386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f043ea-b61c-4b4b-be06-2d367f528ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.726659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f043ea-b61c-4b4b-be06-2d367f528ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.726924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f043ea-b61c-4b4b-be06-2d367f528ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.727573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f043ea-b61c-4b4b-be06-2d367f528ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:19.727874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f043ea-b61c-4b4b-be06-2d367f528ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:19.729247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f043ea-b61c-4b4b-be06-2d367f528ee1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:19.754628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 242/489] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:19.760267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f043ea-b61c-4b4b-be06-2d367f528ee1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:19.783024 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 248/490] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:19.860853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad83b8-9c1d-4563-bded-2516644c1435 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:19.903273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f043ea-b61c-4b4b-be06-2d367f528ee1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:19.922671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:19.923635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:19.959753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a121feb-7fa6-48ac-a761-b1f5192cc5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:19.960549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a121feb-7fa6-48ac-a761-b1f5192cc5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.960975 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a121feb-7fa6-48ac-a761-b1f5192cc5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.961829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a121feb-7fa6-48ac-a761-b1f5192cc5a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.969741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a121feb-7fa6-48ac-a761-b1f5192cc5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:19.971310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a121feb-7fa6-48ac-a761-b1f5192cc5a6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6a121feb-7fa6-48ac-a761-b1f5192cc5a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:19.986665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:19.988112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:19.989198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 243/491] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 07:44:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:19.995202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753b8e-ad64-4395-9290-72f2b96ac575 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:19.995590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753b8e-ad64-4395-9290-72f2b96ac575 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:19.995869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753b8e-ad64-4395-9290-72f2b96ac575 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:19.997554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 244/492] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:19.999221 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73753b8e-ad64-4395-9290-72f2b96ac575 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.007407 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad83b8-9c1d-4563-bded-2516644c1435 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.042939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f876b-03ae-4be3-875c-a95b718016c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.043565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f876b-03ae-4be3-875c-a95b718016c0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.043841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f876b-03ae-4be3-875c-a95b718016c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.044112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f876b-03ae-4be3-875c-a95b718016c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.055883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f876b-03ae-4be3-875c-a95b718016c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-310f876b-03ae-4be3-875c-a95b718016c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:20.060837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:20.062895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 249/493] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:20.064787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa9100-b527-4d10-b185-3a7ca46156c3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.067405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa9100-b527-4d10-b185-3a7ca46156c3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.067405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa9100-b527-4d10-b185-3a7ca46156c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.083803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5dfa9100-b527-4d10-b185-3a7ca46156c3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:20.085047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5dfa9100-b527-4d10-b185-3a7ca46156c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:20.118930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73753b8e-ad64-4395-9290-72f2b96ac575 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.154782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33506ab-dedb-42a9-be9b-d8508aff6fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.155386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33506ab-dedb-42a9-be9b-d8508aff6fdd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.155722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33506ab-dedb-42a9-be9b-d8508aff6fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.156007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33506ab-dedb-42a9-be9b-d8508aff6fdd None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.156734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33506ab-dedb-42a9-be9b-d8508aff6fdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:20.157044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33506ab-dedb-42a9-be9b-d8508aff6fdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:20.158514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33506ab-dedb-42a9-be9b-d8508aff6fdd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:20.162528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 250/494] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:20.163644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa9100-b527-4d10-b185-3a7ca46156c3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.198470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:20.204721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 245/495] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 07:44:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:20.206545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33506ab-dedb-42a9-be9b-d8508aff6fdd None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.243945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:20.299182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa9100-b527-4d10-b185-3a7ca46156c3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.336673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33506ab-dedb-42a9-be9b-d8508aff6fdd None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.344430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521ec59-6657-482f-8576-f3f5420ff974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.345161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521ec59-6657-482f-8576-f3f5420ff974 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.346030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521ec59-6657-482f-8576-f3f5420ff974 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.346916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521ec59-6657-482f-8576-f3f5420ff974 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.348311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521ec59-6657-482f-8576-f3f5420ff974 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:20.348686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521ec59-6657-482f-8576-f3f5420ff974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:20.350329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521ec59-6657-482f-8576-f3f5420ff974 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:20.360570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 251/496] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:20.362821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521ec59-6657-482f-8576-f3f5420ff974 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.386927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f889d5-db0f-46e2-9e51-36d764f467f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.387797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f889d5-db0f-46e2-9e51-36d764f467f1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.388218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f889d5-db0f-46e2-9e51-36d764f467f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.390434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f889d5-db0f-46e2-9e51-36d764f467f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.404279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f889d5-db0f-46e2-9e51-36d764f467f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-62f889d5-db0f-46e2-9e51-36d764f467f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:20.411035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:20.412277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:20.413235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 246/497] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:20.414867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f889d5-db0f-46e2-9e51-36d764f467f1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.476000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:20.492490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521ec59-6657-482f-8576-f3f5420ff974 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.509699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:20.524745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f889d5-db0f-46e2-9e51-36d764f467f1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.530147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e133-efea-419f-800d-4d13dc80fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.530756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e133-efea-419f-800d-4d13dc80fd55 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.531029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e133-efea-419f-800d-4d13dc80fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.531297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e133-efea-419f-800d-4d13dc80fd55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.562513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb810a2-0f9f-43ad-9a49-203bc61979f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.563144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb810a2-0f9f-43ad-9a49-203bc61979f7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.563449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb810a2-0f9f-43ad-9a49-203bc61979f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.563716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb810a2-0f9f-43ad-9a49-203bc61979f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.574247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb810a2-0f9f-43ad-9a49-203bc61979f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:20.575694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb810a2-0f9f-43ad-9a49-203bc61979f7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1cb810a2-0f9f-43ad-9a49-203bc61979f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:20.590336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:20.592086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:20.593194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:20.593194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:20.593194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:20.593194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 247/498] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:20.593194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb810a2-0f9f-43ad-9a49-203bc61979f7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.608713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e133-efea-419f-800d-4d13dc80fd55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:20.610244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e133-efea-419f-800d-4d13dc80fd55 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:20.690845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb810a2-0f9f-43ad-9a49-203bc61979f7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.693219 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:20.708775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 252/499] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:20.709615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e133-efea-419f-800d-4d13dc80fd55 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.728067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724731a3-f3ea-47a4-9454-07145e56463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.728701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724731a3-f3ea-47a4-9454-07145e56463a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.728979 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724731a3-f3ea-47a4-9454-07145e56463a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.729248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724731a3-f3ea-47a4-9454-07145e56463a None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.729943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724731a3-f3ea-47a4-9454-07145e56463a None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:20.730242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724731a3-f3ea-47a4-9454-07145e56463a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:20.731598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724731a3-f3ea-47a4-9454-07145e56463a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:20.736560 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:20.740206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 248/500] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:20.741396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e229-d260-406c-bc63-6b7b2f4bb962 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.741705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e229-d260-406c-bc63-6b7b2f4bb962 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.746579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e229-d260-406c-bc63-6b7b2f4bb962 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.746579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 249/501] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:20.746579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376e229-d260-406c-bc63-6b7b2f4bb962 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.816844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e133-efea-419f-800d-4d13dc80fd55 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.843960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376e229-d260-406c-bc63-6b7b2f4bb962 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.852233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a3cc-f719-4349-9919-ba1336e8ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.852852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a3cc-f719-4349-9919-ba1336e8ef8d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.853124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a3cc-f719-4349-9919-ba1336e8ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.853393 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201a3cc-f719-4349-9919-ba1336e8ef8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.863256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201a3cc-f719-4349-9919-ba1336e8ef8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1201a3cc-f719-4349-9919-ba1336e8ef8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:20.867940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:20.869007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 253/502] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:20.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a3cc-f719-4349-9919-ba1336e8ef8d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.877128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a708ef-f7cf-4e8a-b73c-b9a523e9503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:20.877784 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a708ef-f7cf-4e8a-b73c-b9a523e9503d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:20.878047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a708ef-f7cf-4e8a-b73c-b9a523e9503d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:20.878311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a708ef-f7cf-4e8a-b73c-b9a523e9503d None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:20.878944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a708ef-f7cf-4e8a-b73c-b9a523e9503d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:20.879240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a708ef-f7cf-4e8a-b73c-b9a523e9503d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:20.880576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a708ef-f7cf-4e8a-b73c-b9a523e9503d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:20.892089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 250/503] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:20.892872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a708ef-f7cf-4e8a-b73c-b9a523e9503d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:20.916958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:20.953040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:20.969864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201a3cc-f719-4349-9919-ba1336e8ef8d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:20.993804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a708ef-f7cf-4e8a-b73c-b9a523e9503d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.005015 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1790368-356c-4206-9854-5bc050a444a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.005755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790368-356c-4206-9854-5bc050a444a9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.006031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790368-356c-4206-9854-5bc050a444a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.006295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790368-356c-4206-9854-5bc050a444a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.015933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1790368-356c-4206-9854-5bc050a444a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.017360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1790368-356c-4206-9854-5bc050a444a9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.027094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdab33-e993-418e-9e87-53673893ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.027707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdab33-e993-418e-9e87-53673893ed3d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.027976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdab33-e993-418e-9e87-53673893ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.028241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdab33-e993-418e-9e87-53673893ed3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-c1790368-356c-4206-9854-5bc050a444a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:21.032119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:21.033187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:21.039209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:21.039209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:21.039209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:21.039209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 254/504] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:21.039209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd06a6-90f9-4eb6-8dd5-804399d20bf8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.039209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd06a6-90f9-4eb6-8dd5-804399d20bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.039209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd06a6-90f9-4eb6-8dd5-804399d20bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.039602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdab33-e993-418e-9e87-53673893ed3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.040427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdab33-e993-418e-9e87-53673893ed3d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.052296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a8dd06a6-90f9-4eb6-8dd5-804399d20bf8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:21.053503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a8dd06a6-90f9-4eb6-8dd5-804399d20bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-b5cdab33-e993-418e-9e87-53673893ed3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:21.054677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:21.055703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:21.056722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:21.056722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:21.056722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:21.056722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 251/505] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:21.056987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdab33-e993-418e-9e87-53673893ed3d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.126161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 255/506] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:21.126917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd06a6-90f9-4eb6-8dd5-804399d20bf8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.165209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.178886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdab33-e993-418e-9e87-53673893ed3d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.192550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.214346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6fd5-cb71-4516-a74f-45bf467842b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.214991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6fd5-cb71-4516-a74f-45bf467842b2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.215269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6fd5-cb71-4516-a74f-45bf467842b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.215536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6fd5-cb71-4516-a74f-45bf467842b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.216201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed6fd5-cb71-4516-a74f-45bf467842b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:21.216503 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed6fd5-cb71-4516-a74f-45bf467842b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.217910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed6fd5-cb71-4516-a74f-45bf467842b2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.227385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 252/507] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:21.228218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6fd5-cb71-4516-a74f-45bf467842b2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.249743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd06a6-90f9-4eb6-8dd5-804399d20bf8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.285953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51036c6-c90d-4b84-ba6d-11d7b4313922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.286840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51036c6-c90d-4b84-ba6d-11d7b4313922 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.287101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51036c6-c90d-4b84-ba6d-11d7b4313922 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.287360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51036c6-c90d-4b84-ba6d-11d7b4313922 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.294510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51036c6-c90d-4b84-ba6d-11d7b4313922 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.295968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51036c6-c90d-4b84-ba6d-11d7b4313922 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f51036c6-c90d-4b84-ba6d-11d7b4313922 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:21.310181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:21.311175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 256/508] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:21.312103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51036c6-c90d-4b84-ba6d-11d7b4313922 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.339462 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6fd5-cb71-4516-a74f-45bf467842b2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.379023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d77b1-bcf8-48fb-a66f-df8c4f7ed126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.379559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d77b1-bcf8-48fb-a66f-df8c4f7ed126 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.379856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d77b1-bcf8-48fb-a66f-df8c4f7ed126 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.380116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d77b1-bcf8-48fb-a66f-df8c4f7ed126 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.380813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d77b1-bcf8-48fb-a66f-df8c4f7ed126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:21.381112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d77b1-bcf8-48fb-a66f-df8c4f7ed126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.382529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d77b1-bcf8-48fb-a66f-df8c4f7ed126 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.395551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 253/509] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:21.398449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d77b1-bcf8-48fb-a66f-df8c4f7ed126 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.413893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.425872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51036c6-c90d-4b84-ba6d-11d7b4313922 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.432369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.459079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a6748-a857-4fd8-9fdb-c0b850b32eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.459678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6748-a857-4fd8-9fdb-c0b850b32eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.459964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6748-a857-4fd8-9fdb-c0b850b32eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.460222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6748-a857-4fd8-9fdb-c0b850b32eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.460852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6748-a857-4fd8-9fdb-c0b850b32eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:21.461152 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6748-a857-4fd8-9fdb-c0b850b32eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.462565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6748-a857-4fd8-9fdb-c0b850b32eb8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.474386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 257/510] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:21.475193 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a6748-a857-4fd8-9fdb-c0b850b32eb8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.495975 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d77b1-bcf8-48fb-a66f-df8c4f7ed126 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.529762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090bfb3-578b-4c67-889b-77db534c7860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.530385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090bfb3-578b-4c67-889b-77db534c7860 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.530655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090bfb3-578b-4c67-889b-77db534c7860 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.530920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090bfb3-578b-4c67-889b-77db534c7860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.541808 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090bfb3-578b-4c67-889b-77db534c7860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.543233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090bfb3-578b-4c67-889b-77db534c7860 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-8090bfb3-578b-4c67-889b-77db534c7860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:21.556869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:21.557812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:21.558674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:21.558674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:21.558674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:21.558674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 254/511] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:21.558901 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090bfb3-578b-4c67-889b-77db534c7860 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.578138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a6748-a857-4fd8-9fdb-c0b850b32eb8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.611965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99dab-e64e-425c-8f52-adda593a4af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.612778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99dab-e64e-425c-8f52-adda593a4af8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.613050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99dab-e64e-425c-8f52-adda593a4af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.613318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99dab-e64e-425c-8f52-adda593a4af8 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.614065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b99dab-e64e-425c-8f52-adda593a4af8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:21.614369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b99dab-e64e-425c-8f52-adda593a4af8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.615799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b99dab-e64e-425c-8f52-adda593a4af8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.639843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.651877 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 258/512] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:21.652698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99dab-e64e-425c-8f52-adda593a4af8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.659350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090bfb3-578b-4c67-889b-77db534c7860 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.661009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.694182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83e79c-5590-4c34-98d4-6a332f1602d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.694835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83e79c-5590-4c34-98d4-6a332f1602d9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.695112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83e79c-5590-4c34-98d4-6a332f1602d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.695383 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83e79c-5590-4c34-98d4-6a332f1602d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.702031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83e79c-5590-4c34-98d4-6a332f1602d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.703459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83e79c-5590-4c34-98d4-6a332f1602d9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-8e83e79c-5590-4c34-98d4-6a332f1602d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:21.715502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:21.716539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 255/513] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:21.717770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83e79c-5590-4c34-98d4-6a332f1602d9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.751734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99dab-e64e-425c-8f52-adda593a4af8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.785547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deccdda-5f46-4c17-b7eb-e3cacb8f3629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.786167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deccdda-5f46-4c17-b7eb-e3cacb8f3629 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.786691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deccdda-5f46-4c17-b7eb-e3cacb8f3629 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.786956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deccdda-5f46-4c17-b7eb-e3cacb8f3629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.797244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deccdda-5f46-4c17-b7eb-e3cacb8f3629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.798717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deccdda-5f46-4c17-b7eb-e3cacb8f3629 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5deccdda-5f46-4c17-b7eb-e3cacb8f3629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:21.813033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:21.813987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:21.814831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:21.814831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:21.814831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:21.814831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 259/514] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:21.815545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deccdda-5f46-4c17-b7eb-e3cacb8f3629 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.821460 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83e79c-5590-4c34-98d4-6a332f1602d9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.857809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693bda8-2fc7-4165-8c7b-1e3bf22ef9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.858436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693bda8-2fc7-4165-8c7b-1e3bf22ef9ec None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.858714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693bda8-2fc7-4165-8c7b-1e3bf22ef9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.858984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693bda8-2fc7-4165-8c7b-1e3bf22ef9ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.866008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693bda8-2fc7-4165-8c7b-1e3bf22ef9ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.867449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693bda8-2fc7-4165-8c7b-1e3bf22ef9ec None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.876553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-3693bda8-2fc7-4165-8c7b-1e3bf22ef9ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:21.880861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:21.881821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 256/515] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:21.882724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693bda8-2fc7-4165-8c7b-1e3bf22ef9ec None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.896249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:21.922936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deccdda-5f46-4c17-b7eb-e3cacb8f3629 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:21.957501 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0756be-ffa1-4dfd-839e-218098521dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:21.958209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0756be-ffa1-4dfd-839e-218098521dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:21.958492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0756be-ffa1-4dfd-839e-218098521dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:21.958764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0756be-ffa1-4dfd-839e-218098521dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:21.959409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0756be-ffa1-4dfd-839e-218098521dc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:21.959711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0756be-ffa1-4dfd-839e-218098521dc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:21.961126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0756be-ffa1-4dfd-839e-218098521dc2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:21.972974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 260/516] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:21.973804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0756be-ffa1-4dfd-839e-218098521dc2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:21.987879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693bda8-2fc7-4165-8c7b-1e3bf22ef9ec None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.021867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f4b4a-055e-4bf3-acc7-3180b1650680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.022470 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f4b4a-055e-4bf3-acc7-3180b1650680 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.022747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f4b4a-055e-4bf3-acc7-3180b1650680 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.023017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f4b4a-055e-4bf3-acc7-3180b1650680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.070520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0756be-ffa1-4dfd-839e-218098521dc2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.087120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.089360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f4b4a-055e-4bf3-acc7-3180b1650680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.090834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f4b4a-055e-4bf3-acc7-3180b1650680 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.098261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.103748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba51e7-41f6-4742-baed-f4ef849f8ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.104328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba51e7-41f6-4742-baed-f4ef849f8ddb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.104598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba51e7-41f6-4742-baed-f4ef849f8ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.104869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba51e7-41f6-4742-baed-f4ef849f8ddb None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.105572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba51e7-41f6-4742-baed-f4ef849f8ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:22.105964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba51e7-41f6-4742-baed-f4ef849f8ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.107382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba51e7-41f6-4742-baed-f4ef849f8ddb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.125163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 261/517] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:22.126307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba51e7-41f6-4742-baed-f4ef849f8ddb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.187270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 257/518] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:22.188018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f4b4a-055e-4bf3-acc7-3180b1650680 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.231670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba51e7-41f6-4742-baed-f4ef849f8ddb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.266540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcf804-8e8e-4610-b78f-91b93a5f4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.267134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcf804-8e8e-4610-b78f-91b93a5f4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.267477 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcf804-8e8e-4610-b78f-91b93a5f4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.267778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcf804-8e8e-4610-b78f-91b93a5f4fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.269096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcf804-8e8e-4610-b78f-91b93a5f4fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:22.269320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcf804-8e8e-4610-b78f-91b93a5f4fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.270721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcf804-8e8e-4610-b78f-91b93a5f4fe0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.281537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 262/519] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:22.282307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcf804-8e8e-4610-b78f-91b93a5f4fe0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.290149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f4b4a-055e-4bf3-acc7-3180b1650680 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.297559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.322535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.324771 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ba27-3004-4219-90cb-3685d763cdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.325734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ba27-3004-4219-90cb-3685d763cdfe None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.326005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ba27-3004-4219-90cb-3685d763cdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.326273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328ba27-3004-4219-90cb-3685d763cdfe None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.326996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ba27-3004-4219-90cb-3685d763cdfe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:22.327297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ba27-3004-4219-90cb-3685d763cdfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.328699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328ba27-3004-4219-90cb-3685d763cdfe None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.347310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 258/520] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:22.348318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ba27-3004-4219-90cb-3685d763cdfe None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.384998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcf804-8e8e-4610-b78f-91b93a5f4fe0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.418712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcaed3-08d1-4bd5-a9c3-9c8ba172986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.419333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcaed3-08d1-4bd5-a9c3-9c8ba172986a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.419615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcaed3-08d1-4bd5-a9c3-9c8ba172986a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.419869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcaed3-08d1-4bd5-a9c3-9c8ba172986a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.427174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcaed3-08d1-4bd5-a9c3-9c8ba172986a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.428602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcaed3-08d1-4bd5-a9c3-9c8ba172986a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-fabcaed3-08d1-4bd5-a9c3-9c8ba172986a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:22.439377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:22.440767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 263/521] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:22.441716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcaed3-08d1-4bd5-a9c3-9c8ba172986a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.451519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328ba27-3004-4219-90cb-3685d763cdfe None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.485356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d891b-7f3e-4188-ba4c-9ca8845c943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.486056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d891b-7f3e-4188-ba4c-9ca8845c943f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.486345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d891b-7f3e-4188-ba4c-9ca8845c943f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.486593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d891b-7f3e-4188-ba4c-9ca8845c943f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.487352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d891b-7f3e-4188-ba4c-9ca8845c943f None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=6ef753445d864a0ab30ec970446b29cd) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:22.487651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d891b-7f3e-4188-ba4c-9ca8845c943f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.489072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d891b-7f3e-4188-ba4c-9ca8845c943f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.494279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 259/522] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/role_assignments?user.id=6ef753445d864a0ab30ec970446b29cd&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:22.498388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d891b-7f3e-4188-ba4c-9ca8845c943f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.532115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.549445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.555780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcaed3-08d1-4bd5-a9c3-9c8ba172986a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.595307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c115-ea75-4183-800e-8bdb19a9a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.595954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c115-ea75-4183-800e-8bdb19a9a237 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.596259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c115-ea75-4183-800e-8bdb19a9a237 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.596562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c115-ea75-4183-800e-8bdb19a9a237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.608281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363c115-ea75-4183-800e-8bdb19a9a237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.610382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363c115-ea75-4183-800e-8bdb19a9a237 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.618813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d891b-7f3e-4188-ba4c-9ca8845c943f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7363c115-ea75-4183-800e-8bdb19a9a237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:22.627306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:22.628873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:22.630350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:22.630350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:22.630350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:22.630350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 264/523] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:22.630350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c115-ea75-4183-800e-8bdb19a9a237 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.660755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69306ed0-6f41-4336-ad71-5587981605b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.661641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69306ed0-6f41-4336-ad71-5587981605b2 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.661911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69306ed0-6f41-4336-ad71-5587981605b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.662175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69306ed0-6f41-4336-ad71-5587981605b2 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.662807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69306ed0-6f41-4336-ad71-5587981605b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.664230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69306ed0-6f41-4336-ad71-5587981605b2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.734284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c115-ea75-4183-800e-8bdb19a9a237 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.761505 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 260/524] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:22 2022] POST /identity/v3/users => generated 247 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:22.761505 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69306ed0-6f41-4336-ad71-5587981605b2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:22.788980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552964b-d048-43b0-8895-de84e57790bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.789866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552964b-d048-43b0-8895-de84e57790bb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.790559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552964b-d048-43b0-8895-de84e57790bb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.790840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552964b-d048-43b0-8895-de84e57790bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.818406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.854884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:22.879427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69306ed0-6f41-4336-ad71-5587981605b2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:22.884375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552964b-d048-43b0-8895-de84e57790bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.886087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552964b-d048-43b0-8895-de84e57790bb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.920696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac70d36-7b28-4d51-9409-afe151fbad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:22.921429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac70d36-7b28-4d51-9409-afe151fbad83 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:22.921803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac70d36-7b28-4d51-9409-afe151fbad83 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:22.922140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac70d36-7b28-4d51-9409-afe151fbad83 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:22.922944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac70d36-7b28-4d51-9409-afe151fbad83 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:22.923315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac70d36-7b28-4d51-9409-afe151fbad83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:22.925494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac70d36-7b28-4d51-9409-afe151fbad83 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:22.947328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 261/525] 10.222.0.58 () {56 vars in 1139 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:22.948187 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac70d36-7b28-4d51-9409-afe151fbad83 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.026838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 265/526] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:23.027623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552964b-d048-43b0-8895-de84e57790bb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.082766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac70d36-7b28-4d51-9409-afe151fbad83 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.083532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.139585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdad98-ae89-4d8f-8c12-d6d500723a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.140519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdad98-ae89-4d8f-8c12-d6d500723a86 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.140792 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdad98-ae89-4d8f-8c12-d6d500723a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.141057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdad98-ae89-4d8f-8c12-d6d500723a86 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.141788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdad98-ae89-4d8f-8c12-d6d500723a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:23.142085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdad98-ae89-4d8f-8c12-d6d500723a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.142420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552964b-d048-43b0-8895-de84e57790bb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.144248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdad98-ae89-4d8f-8c12-d6d500723a86 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.160339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 262/527] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:23.162321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdad98-ae89-4d8f-8c12-d6d500723a86 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.165566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.198527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ef954-bc9d-499a-830f-70705a6dd232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.199134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef954-bc9d-499a-830f-70705a6dd232 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.199409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef954-bc9d-499a-830f-70705a6dd232 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.199677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ef954-bc9d-499a-830f-70705a6dd232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.285345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdad98-ae89-4d8f-8c12-d6d500723a86 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.296861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ef954-bc9d-499a-830f-70705a6dd232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.299470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ef954-bc9d-499a-830f-70705a6dd232 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.325146 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da3c58-d9e8-4190-ac39-e1a1b04036ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.325807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da3c58-d9e8-4190-ac39-e1a1b04036ea None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.326085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da3c58-d9e8-4190-ac39-e1a1b04036ea None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.326392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da3c58-d9e8-4190-ac39-e1a1b04036ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.339090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da3c58-d9e8-4190-ac39-e1a1b04036ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.340561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da3c58-d9e8-4190-ac39-e1a1b04036ea None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a3da3c58-d9e8-4190-ac39-e1a1b04036ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:23.356320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:23.357316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:23.358220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:23.358220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:23.358220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:23.361959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 263/528] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:23.363221 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da3c58-d9e8-4190-ac39-e1a1b04036ea None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.369846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.429901 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.446685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 266/529] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:23.447818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ef954-bc9d-499a-830f-70705a6dd232 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.489190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da3c58-d9e8-4190-ac39-e1a1b04036ea None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.539678 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513ae0b-c192-4716-a021-4cad13c8e18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.540800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513ae0b-c192-4716-a021-4cad13c8e18d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.541645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513ae0b-c192-4716-a021-4cad13c8e18d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.542106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513ae0b-c192-4716-a021-4cad13c8e18d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.553506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513ae0b-c192-4716-a021-4cad13c8e18d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.556020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513ae0b-c192-4716-a021-4cad13c8e18d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.557495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ef954-bc9d-499a-830f-70705a6dd232 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-4513ae0b-c192-4716-a021-4cad13c8e18d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:23.570743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:23.571817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:23.572913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:23.572913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:23.572913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:23.572913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:23.572913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:23.572913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:23.572913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:23.572913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:23.574995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 264/530] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:23.575869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513ae0b-c192-4716-a021-4cad13c8e18d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.603514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da4751-0df8-43dc-8ecd-9a2e404c329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.604934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da4751-0df8-43dc-8ecd-9a2e404c329b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.605369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da4751-0df8-43dc-8ecd-9a2e404c329b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.606231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da4751-0df8-43dc-8ecd-9a2e404c329b None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.607069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da4751-0df8-43dc-8ecd-9a2e404c329b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:23.607526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da4751-0df8-43dc-8ecd-9a2e404c329b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.609358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da4751-0df8-43dc-8ecd-9a2e404c329b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.626584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 267/531] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:23.628573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da4751-0df8-43dc-8ecd-9a2e404c329b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.645397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.687642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513ae0b-c192-4716-a021-4cad13c8e18d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.703086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.723753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1b587-5c87-43ed-8961-8e1cf0fa63be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.724531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b587-5c87-43ed-8961-8e1cf0fa63be None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.724906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b587-5c87-43ed-8961-8e1cf0fa63be None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.725331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b587-5c87-43ed-8961-8e1cf0fa63be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.735899 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1b587-5c87-43ed-8961-8e1cf0fa63be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.738187 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1b587-5c87-43ed-8961-8e1cf0fa63be None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-91d1b587-5c87-43ed-8961-8e1cf0fa63be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:23.754668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:23.755801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:23.756866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:23.756866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:23.756866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:23.758299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 265/532] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:23.759152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1b587-5c87-43ed-8961-8e1cf0fa63be None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.764633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da4751-0df8-43dc-8ecd-9a2e404c329b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.810717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc7b79-9c9d-4e70-aa2c-9388b1a4a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.811581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc7b79-9c9d-4e70-aa2c-9388b1a4a570 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.812228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc7b79-9c9d-4e70-aa2c-9388b1a4a570 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.812640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc7b79-9c9d-4e70-aa2c-9388b1a4a570 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.813859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc7b79-9c9d-4e70-aa2c-9388b1a4a570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:23.814322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc7b79-9c9d-4e70-aa2c-9388b1a4a570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.816533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc7b79-9c9d-4e70-aa2c-9388b1a4a570 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.833963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 268/533] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:23.835834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc7b79-9c9d-4e70-aa2c-9388b1a4a570 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.867808 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1b587-5c87-43ed-8961-8e1cf0fa63be None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.915025 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6d462-92ab-4b64-837d-dfeb9bc31ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.916501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6d462-92ab-4b64-837d-dfeb9bc31ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.916922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6d462-92ab-4b64-837d-dfeb9bc31ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.917332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6d462-92ab-4b64-837d-dfeb9bc31ef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:23.919686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.927779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6d462-92ab-4b64-837d-dfeb9bc31ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:23.929489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6d462-92ab-4b64-837d-dfeb9bc31ef9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-4dd6d462-92ab-4b64-837d-dfeb9bc31ef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:23.945366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:23.946499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:23.947550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:23.947550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:23.947550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:23.947550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:23.947550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:23.947550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:23.947550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:23.947550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:23.949659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 266/534] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:23.950934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6d462-92ab-4b64-837d-dfeb9bc31ef9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:23.961349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc7b79-9c9d-4e70-aa2c-9388b1a4a570 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:23.988326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:23.998649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c630f-969a-4007-bebc-d4ac56c75756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:23.999253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c630f-969a-4007-bebc-d4ac56c75756 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:23.999530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c630f-969a-4007-bebc-d4ac56c75756 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:23.999800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c630f-969a-4007-bebc-d4ac56c75756 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.000460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c630f-969a-4007-bebc-d4ac56c75756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:24.003376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c630f-969a-4007-bebc-d4ac56c75756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.003376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c630f-969a-4007-bebc-d4ac56c75756 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.020375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 269/535] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.021298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c630f-969a-4007-bebc-d4ac56c75756 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.075313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6d462-92ab-4b64-837d-dfeb9bc31ef9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.121903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cae53-3555-4276-a9c6-57aaf5857463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.122919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cae53-3555-4276-a9c6-57aaf5857463 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.123195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cae53-3555-4276-a9c6-57aaf5857463 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.123641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cae53-3555-4276-a9c6-57aaf5857463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.124506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4cae53-3555-4276-a9c6-57aaf5857463 None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=79bb81300cff46b7ba1680eedf2762cf) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:24.124867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4cae53-3555-4276-a9c6-57aaf5857463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.127143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4cae53-3555-4276-a9c6-57aaf5857463 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.135555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 267/536] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:23 2022] GET /identity/v3/role_assignments?user.id=79bb81300cff46b7ba1680eedf2762cf&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.137037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cae53-3555-4276-a9c6-57aaf5857463 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.146179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c630f-969a-4007-bebc-d4ac56c75756 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.178810 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.186006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037acd19-4b93-4b4e-87f2-63a3cd82ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.186835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037acd19-4b93-4b4e-87f2-63a3cd82ab8d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.187302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037acd19-4b93-4b4e-87f2-63a3cd82ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.187761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037acd19-4b93-4b4e-87f2-63a3cd82ab8d None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.188670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037acd19-4b93-4b4e-87f2-63a3cd82ab8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:24.189173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037acd19-4b93-4b4e-87f2-63a3cd82ab8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.191766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037acd19-4b93-4b4e-87f2-63a3cd82ab8d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.205111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 270/537] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.226556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037acd19-4b93-4b4e-87f2-63a3cd82ab8d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.267504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.280161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cae53-3555-4276-a9c6-57aaf5857463 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.334425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4a44a-d136-4fa1-8cda-fb420e4a2b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.335119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4a44a-d136-4fa1-8cda-fb420e4a2b1b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.335491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4a44a-d136-4fa1-8cda-fb420e4a2b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.335850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4a44a-d136-4fa1-8cda-fb420e4a2b1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.354734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4a44a-d136-4fa1-8cda-fb420e4a2b1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.355739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4a44a-d136-4fa1-8cda-fb420e4a2b1b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-69a4a44a-d136-4fa1-8cda-fb420e4a2b1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:24.375955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:24.377030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:24.378182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:24.378182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:24.378182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:24.378182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:24.378182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:24.378182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:24.378182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:24.378182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:24.383318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 268/538] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:24.389235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4a44a-d136-4fa1-8cda-fb420e4a2b1b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.394247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037acd19-4b93-4b4e-87f2-63a3cd82ab8d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.438820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99b60c-5494-40d8-8afe-698060defb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.439660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99b60c-5494-40d8-8afe-698060defb84 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.440730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99b60c-5494-40d8-8afe-698060defb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.441437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99b60c-5494-40d8-8afe-698060defb84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.442443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99b60c-5494-40d8-8afe-698060defb84 None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=23734a2b701a46c3a25ae547aff98026) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:24.442902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99b60c-5494-40d8-8afe-698060defb84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.445526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99b60c-5494-40d8-8afe-698060defb84 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.453003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 271/539] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/role_assignments?user.id=23734a2b701a46c3a25ae547aff98026&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.474918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915f76e-5d2f-481f-b874-03f738f87f5d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.475455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915f76e-5d2f-481f-b874-03f738f87f5d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.475876 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915f76e-5d2f-481f-b874-03f738f87f5d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.477702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 272/540] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:24.483009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8c64-d2c6-40e9-bea7-4c6a18666386 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.483506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8c64-d2c6-40e9-bea7-4c6a18666386 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.483946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8c64-d2c6-40e9-bea7-4c6a18666386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.511867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ad2b8c64-d2c6-40e9-bea7-4c6a18666386 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:24.513346 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ad2b8c64-d2c6-40e9-bea7-4c6a18666386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:24.545842 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4a44a-d136-4fa1-8cda-fb420e4a2b1b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.583252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7b26-e2a9-4365-9b3f-4a6a6568dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.584675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7b26-e2a9-4365-9b3f-4a6a6568dcaa None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.585227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7b26-e2a9-4365-9b3f-4a6a6568dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.586319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7b26-e2a9-4365-9b3f-4a6a6568dcaa None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.587150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a7b26-e2a9-4365-9b3f-4a6a6568dcaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:24.587887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a7b26-e2a9-4365-9b3f-4a6a6568dcaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.590093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a7b26-e2a9-4365-9b3f-4a6a6568dcaa None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.623386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.628185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 269/541] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:24.634480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7b26-e2a9-4365-9b3f-4a6a6568dcaa None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:24.652275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 273/542] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:24.663391 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.751729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7b26-e2a9-4365-9b3f-4a6a6568dcaa None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:24.788031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f135fde-e1e2-4e25-a06d-2cb074161e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:24.788645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135fde-e1e2-4e25-a06d-2cb074161e8d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:24.788921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135fde-e1e2-4e25-a06d-2cb074161e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:24.789189 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135fde-e1e2-4e25-a06d-2cb074161e8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:24.789952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f135fde-e1e2-4e25-a06d-2cb074161e8d None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=321d07f93b7540128dc5415d8b3252c2) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:24.790260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f135fde-e1e2-4e25-a06d-2cb074161e8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:24.791677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f135fde-e1e2-4e25-a06d-2cb074161e8d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:24.797770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 270/543] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/role_assignments?user.id=321d07f93b7540128dc5415d8b3252c2&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:24.999554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8c64-d2c6-40e9-bea7-4c6a18666386 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.102674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a4054-2cb7-4c0b-ac0a-f1df5133318d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.103041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a4054-2cb7-4c0b-ac0a-f1df5133318d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.103242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a4054-2cb7-4c0b-ac0a-f1df5133318d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.104758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 271/544] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:25.108060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8c64-d2c6-40e9-bea7-4c6a18666386 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.110795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadbad5-0981-49fe-987f-9786be3c9913 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.111078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadbad5-0981-49fe-987f-9786be3c9913 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.111347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadbad5-0981-49fe-987f-9786be3c9913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.140307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1aadbad5-0981-49fe-987f-9786be3c9913 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:25.141538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1aadbad5-0981-49fe-987f-9786be3c9913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:25.162176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c8ca4-742e-4d3f-8ce5-cef859ba55ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.162820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8ca4-742e-4d3f-8ce5-cef859ba55ca None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.163095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8ca4-742e-4d3f-8ce5-cef859ba55ca None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.163362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c8ca4-742e-4d3f-8ce5-cef859ba55ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.181449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c8ca4-742e-4d3f-8ce5-cef859ba55ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-366c8ca4-742e-4d3f-8ce5-cef859ba55ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:25.187063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:25.187934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:25.188729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:25.193330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 274/545] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:25.194696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c8ca4-742e-4d3f-8ce5-cef859ba55ca None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.243048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 272/546] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:25.265621 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.307519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c8ca4-742e-4d3f-8ce5-cef859ba55ca None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.344144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be87ba-9dbf-4a54-9069-ec9f8b1419dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.344751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be87ba-9dbf-4a54-9069-ec9f8b1419dd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.345030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be87ba-9dbf-4a54-9069-ec9f8b1419dd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.345296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be87ba-9dbf-4a54-9069-ec9f8b1419dd None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.345992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be87ba-9dbf-4a54-9069-ec9f8b1419dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:25.346962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be87ba-9dbf-4a54-9069-ec9f8b1419dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.348583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be87ba-9dbf-4a54-9069-ec9f8b1419dd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.365291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 275/547] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:25.365619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadbad5-0981-49fe-987f-9786be3c9913 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.382706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.468291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadbad5-0981-49fe-987f-9786be3c9913 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.503714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe49c-ba42-4611-ad27-66b3e426f95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.504350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe49c-ba42-4611-ad27-66b3e426f95a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.504626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe49c-ba42-4611-ad27-66b3e426f95a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.504895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe49c-ba42-4611-ad27-66b3e426f95a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.515307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfe49c-ba42-4611-ad27-66b3e426f95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.516822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfe49c-ba42-4611-ad27-66b3e426f95a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-16cfe49c-ba42-4611-ad27-66b3e426f95a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:25.532056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:25.532978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:25.534689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:25.534689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:25.534689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:25.538894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 273/548] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:25.540103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be87ba-9dbf-4a54-9069-ec9f8b1419dd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.629091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe49c-ba42-4611-ad27-66b3e426f95a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.651827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be87ba-9dbf-4a54-9069-ec9f8b1419dd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.663217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.693296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42782d8-4c45-4b9b-aede-e16832a2b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.694098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42782d8-4c45-4b9b-aede-e16832a2b4aa None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.694382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42782d8-4c45-4b9b-aede-e16832a2b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.694657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42782d8-4c45-4b9b-aede-e16832a2b4aa None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.695307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42782d8-4c45-4b9b-aede-e16832a2b4aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:25.695612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42782d8-4c45-4b9b-aede-e16832a2b4aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.697003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42782d8-4c45-4b9b-aede-e16832a2b4aa None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.716071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 276/549] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:25.717348 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42782d8-4c45-4b9b-aede-e16832a2b4aa None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.788508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:25.827950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42782d8-4c45-4b9b-aede-e16832a2b4aa None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.866018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef3882-f8c7-4d65-9070-5da506bf8085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:25.866651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef3882-f8c7-4d65-9070-5da506bf8085 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:25.866932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef3882-f8c7-4d65-9070-5da506bf8085 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:25.867208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef3882-f8c7-4d65-9070-5da506bf8085 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:25.875140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef3882-f8c7-4d65-9070-5da506bf8085 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:25.876769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef3882-f8c7-4d65-9070-5da506bf8085 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1bef3882-f8c7-4d65-9070-5da506bf8085 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:25.889929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:25.891035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:25.891952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:25.896265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 277/550] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:25.897612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef3882-f8c7-4d65-9070-5da506bf8085 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:25.899790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe49c-ba42-4611-ad27-66b3e426f95a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:25.941191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.007815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5798ef0-26a2-463c-aa29-3f24d876e286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.008353 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef3882-f8c7-4d65-9070-5da506bf8085 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.008530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5798ef0-26a2-463c-aa29-3f24d876e286 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.008798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5798ef0-26a2-463c-aa29-3f24d876e286 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.009068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5798ef0-26a2-463c-aa29-3f24d876e286 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.047009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5798ef0-26a2-463c-aa29-3f24d876e286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:26.049272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c4fe5-5c05-41e2-beb1-76ea7f8efa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.049957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c4fe5-5c05-41e2-beb1-76ea7f8efa17 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.050278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c4fe5-5c05-41e2-beb1-76ea7f8efa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.050610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c4fe5-5c05-41e2-beb1-76ea7f8efa17 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.051420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c4fe5-5c05-41e2-beb1-76ea7f8efa17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:26.051722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c4fe5-5c05-41e2-beb1-76ea7f8efa17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.053157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c4fe5-5c05-41e2-beb1-76ea7f8efa17 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f5798ef0-26a2-463c-aa29-3f24d876e286 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:26.054099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:26.055178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:26.056013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:26.061902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 274/551] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:26.068173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5798ef0-26a2-463c-aa29-3f24d876e286 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.078066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 278/552] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 07:44:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:26.079521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c4fe5-5c05-41e2-beb1-76ea7f8efa17 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.193527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.216675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c4fe5-5c05-41e2-beb1-76ea7f8efa17 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.249851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5798ef0-26a2-463c-aa29-3f24d876e286 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.255484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdeebfd-a0c0-4f68-9ea8-c500c0025e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.256118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdeebfd-a0c0-4f68-9ea8-c500c0025e05 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.256394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdeebfd-a0c0-4f68-9ea8-c500c0025e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.256658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdeebfd-a0c0-4f68-9ea8-c500c0025e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.266591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.268788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdeebfd-a0c0-4f68-9ea8-c500c0025e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.270285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdeebfd-a0c0-4f68-9ea8-c500c0025e05 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.285219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09719dd5-b719-40de-98b2-48258f9ddde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.285933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09719dd5-b719-40de-98b2-48258f9ddde8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.286531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09719dd5-b719-40de-98b2-48258f9ddde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.286866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09719dd5-b719-40de-98b2-48258f9ddde8 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.287611 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09719dd5-b719-40de-98b2-48258f9ddde8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:26.287978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09719dd5-b719-40de-98b2-48258f9ddde8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.289401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09719dd5-b719-40de-98b2-48258f9ddde8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ccdeebfd-a0c0-4f68-9ea8-c500c0025e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:26.294010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:26.294944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:26.295823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:26.295823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:26.295823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:26.299118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 275/553] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:26.299761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 279/554] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:26.301715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09719dd5-b719-40de-98b2-48258f9ddde8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.304964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdeebfd-a0c0-4f68-9ea8-c500c0025e05 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.428066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdeebfd-a0c0-4f68-9ea8-c500c0025e05 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.475424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db65a3-ccee-48a7-9cd1-930bfa4e9542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.476055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db65a3-ccee-48a7-9cd1-930bfa4e9542 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.476328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db65a3-ccee-48a7-9cd1-930bfa4e9542 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.476601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db65a3-ccee-48a7-9cd1-930bfa4e9542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.492618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09719dd5-b719-40de-98b2-48258f9ddde8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.498120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db65a3-ccee-48a7-9cd1-930bfa4e9542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.498571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.502220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db65a3-ccee-48a7-9cd1-930bfa4e9542 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-67db65a3-ccee-48a7-9cd1-930bfa4e9542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:26.527444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:26.528509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:26.529854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:26.529854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:26.529854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:26.529854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 280/555] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:26.540922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db65a3-ccee-48a7-9cd1-930bfa4e9542 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.570859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05474431-574a-4da8-b435-6123fa69d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.571926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05474431-574a-4da8-b435-6123fa69d357 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.572508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05474431-574a-4da8-b435-6123fa69d357 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.572951 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05474431-574a-4da8-b435-6123fa69d357 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.573818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05474431-574a-4da8-b435-6123fa69d357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:26.574292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05474431-574a-4da8-b435-6123fa69d357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.575937 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05474431-574a-4da8-b435-6123fa69d357 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.596714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 276/556] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:26.602257 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05474431-574a-4da8-b435-6123fa69d357 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.643871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db65a3-ccee-48a7-9cd1-930bfa4e9542 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.677996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.680363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793cbc6-e208-4a62-b0e6-776cd0f79d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.681169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793cbc6-e208-4a62-b0e6-776cd0f79d9c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.681613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793cbc6-e208-4a62-b0e6-776cd0f79d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.682013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793cbc6-e208-4a62-b0e6-776cd0f79d9c None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.682810 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793cbc6-e208-4a62-b0e6-776cd0f79d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:26.683274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793cbc6-e208-4a62-b0e6-776cd0f79d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.684806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793cbc6-e208-4a62-b0e6-776cd0f79d9c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.698511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 281/557] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:26.706964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793cbc6-e208-4a62-b0e6-776cd0f79d9c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.763194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05474431-574a-4da8-b435-6123fa69d357 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.768355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.799128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc403e1-ed69-4c47-9cce-223b1d6e5ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.800493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc403e1-ed69-4c47-9cce-223b1d6e5ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.800881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc403e1-ed69-4c47-9cce-223b1d6e5ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.801240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc403e1-ed69-4c47-9cce-223b1d6e5ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.809017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc403e1-ed69-4c47-9cce-223b1d6e5ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.810832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc403e1-ed69-4c47-9cce-223b1d6e5ba3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7cc403e1-ed69-4c47-9cce-223b1d6e5ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:26.823423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:26.824821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:26.827154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:26.827154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:26.827154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:26.827154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:26.827154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:26.827154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:26.827154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:26.827154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:26.832123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 277/558] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:26.832123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df6f3e-5517-4de4-b597-82064752f8f9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.832478 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df6f3e-5517-4de4-b597-82064752f8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.832478 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df6f3e-5517-4de4-b597-82064752f8f9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.832777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793cbc6-e208-4a62-b0e6-776cd0f79d9c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.837778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 278/559] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:26.838525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df6f3e-5517-4de4-b597-82064752f8f9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:26.873605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667deb9-51c5-4300-9ea4-0163bb28844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.874246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667deb9-51c5-4300-9ea4-0163bb28844d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.874525 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667deb9-51c5-4300-9ea4-0163bb28844d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.874956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667deb9-51c5-4300-9ea4-0163bb28844d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.885843 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667deb9-51c5-4300-9ea4-0163bb28844d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.887850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667deb9-51c5-4300-9ea4-0163bb28844d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f667deb9-51c5-4300-9ea4-0163bb28844d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:26.903050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:26.904002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:26.905014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:26.906212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 282/560] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:26.906212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996dcdd-4b57-4dba-b69e-d6fb256eb8e6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.906491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996dcdd-4b57-4dba-b69e-d6fb256eb8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.906934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996dcdd-4b57-4dba-b69e-d6fb256eb8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.929654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8996dcdd-4b57-4dba-b69e-d6fb256eb8e6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:26.931265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8996dcdd-4b57-4dba-b69e-d6fb256eb8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:26.939218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:26.944234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df6f3e-5517-4de4-b597-82064752f8f9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:26.978254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505475e-d8db-4644-b299-36212a3a8bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:26.978854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505475e-d8db-4644-b299-36212a3a8bad None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.979123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505475e-d8db-4644-b299-36212a3a8bad None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.979387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505475e-d8db-4644-b299-36212a3a8bad None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.980367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505475e-d8db-4644-b299-36212a3a8bad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:26.980367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505475e-d8db-4644-b299-36212a3a8bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:26.981862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505475e-d8db-4644-b299-36212a3a8bad None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:26.998327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 279/561] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:26.998327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaac48-47a0-4409-82f4-4bbbd9831f4c None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:26.998327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaac48-47a0-4409-82f4-4bbbd9831f4c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:26.998327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaac48-47a0-4409-82f4-4bbbd9831f4c None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:26.998327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 280/562] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:26.998327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebaac48-47a0-4409-82f4-4bbbd9831f4c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.015202 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 283/563] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:27.016286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996dcdd-4b57-4dba-b69e-d6fb256eb8e6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.059932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.132286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebaac48-47a0-4409-82f4-4bbbd9831f4c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.141827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996dcdd-4b57-4dba-b69e-d6fb256eb8e6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.171079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cdcd6-ca0d-464d-bf22-b1e99d5890ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.172187 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cdcd6-ca0d-464d-bf22-b1e99d5890ef None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.172729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cdcd6-ca0d-464d-bf22-b1e99d5890ef None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.173204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cdcd6-ca0d-464d-bf22-b1e99d5890ef None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.174933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cdcd6-ca0d-464d-bf22-b1e99d5890ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:27.175514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cdcd6-ca0d-464d-bf22-b1e99d5890ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.177398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cdcd6-ca0d-464d-bf22-b1e99d5890ef None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.184142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7164fc-1256-46a8-a03d-de1b213acb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.184816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7164fc-1256-46a8-a03d-de1b213acb1f None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.185101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7164fc-1256-46a8-a03d-de1b213acb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.185372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7164fc-1256-46a8-a03d-de1b213acb1f None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/6ef753445d864a0ab30ec970446b29cd/roles/812d9626de92430d9cef17f80d5a1b4e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.200552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 281/564] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 07:44:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:27.202461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa024-03c8-4d24-a61f-57f13f241581 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.202979 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa024-03c8-4d24-a61f-57f13f241581 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.203470 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa024-03c8-4d24-a61f-57f13f241581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.204947 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7164fc-1256-46a8-a03d-de1b213acb1f None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=6ef753445d864a0ab30ec970446b29cd, role_id=812d9626de92430d9cef17f80d5a1b4e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.207205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7164fc-1256-46a8-a03d-de1b213acb1f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.223710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-021aa024-03c8-4d24-a61f-57f13f241581 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:27.228965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-021aa024-03c8-4d24-a61f-57f13f241581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:27.235451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.282320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 284/565] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:27 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/6ef753445d864a0ab30ec970446b29cd/roles/812d9626de92430d9cef17f80d5a1b4e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:27.284664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90607f-dfce-4979-a842-29be67febf3a None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.284920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90607f-dfce-4979-a842-29be67febf3a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.285195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90607f-dfce-4979-a842-29be67febf3a None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.288918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 285/566] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:27.289245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90607f-dfce-4979-a842-29be67febf3a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.309180 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 282/567] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:27.310875 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123f925-75b8-4565-8829-8b7febea06fa None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.311361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123f925-75b8-4565-8829-8b7febea06fa None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.311857 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123f925-75b8-4565-8829-8b7febea06fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.342039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a123f925-75b8-4565-8829-8b7febea06fa None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:27.343659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a123f925-75b8-4565-8829-8b7febea06fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:27.431743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.454147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90607f-dfce-4979-a842-29be67febf3a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.462314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 283/568] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:27.463159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123f925-75b8-4565-8829-8b7febea06fa None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.503002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7c9f8-7ec4-4de3-acf6-8feff86f3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.505106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7c9f8-7ec4-4de3-acf6-8feff86f3502 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.505106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7c9f8-7ec4-4de3-acf6-8feff86f3502 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.505106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7c9f8-7ec4-4de3-acf6-8feff86f3502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.589834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.619228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123f925-75b8-4565-8829-8b7febea06fa None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.626897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7c9f8-7ec4-4de3-acf6-8feff86f3502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.629076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7c9f8-7ec4-4de3-acf6-8feff86f3502 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.669241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f4a77-1c1d-4153-9c73-8217053582b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.669903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f4a77-1c1d-4153-9c73-8217053582b2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.670175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f4a77-1c1d-4153-9c73-8217053582b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.670440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f4a77-1c1d-4153-9c73-8217053582b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.685790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f4a77-1c1d-4153-9c73-8217053582b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ae5f4a77-1c1d-4153-9c73-8217053582b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:27.693206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:27.694230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 284/569] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:27.696624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f4a77-1c1d-4153-9c73-8217053582b2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.723938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.742257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 286/570] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:27.742257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7c9f8-7ec4-4de3-acf6-8feff86f3502 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.818848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f4a77-1c1d-4153-9c73-8217053582b2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.851687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7c9f8-7ec4-4de3-acf6-8feff86f3502 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:27.855031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c2e2c-1653-440d-b0a1-ef863c3da7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.855720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2e2c-1653-440d-b0a1-ef863c3da7cd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.856001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2e2c-1653-440d-b0a1-ef863c3da7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.856266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2e2c-1653-440d-b0a1-ef863c3da7cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.858991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.867833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c2e2c-1653-440d-b0a1-ef863c3da7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-5f2c2e2c-1653-440d-b0a1-ef863c3da7cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:27.873068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:27.874144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:27.875084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:27.881842 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 285/571] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:27.882866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c2e2c-1653-440d-b0a1-ef863c3da7cd None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.889909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032cd70-7a92-456e-8110-87fc37df7bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:27.890517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032cd70-7a92-456e-8110-87fc37df7bbc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:27.890787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032cd70-7a92-456e-8110-87fc37df7bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:27.891052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032cd70-7a92-456e-8110-87fc37df7bbc None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:27.891709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032cd70-7a92-456e-8110-87fc37df7bbc None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:27.892006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032cd70-7a92-456e-8110-87fc37df7bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:27.893629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032cd70-7a92-456e-8110-87fc37df7bbc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:27.902099 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 287/572] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:27.902896 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032cd70-7a92-456e-8110-87fc37df7bbc None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:27.953904 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:27.997589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c2e2c-1653-440d-b0a1-ef863c3da7cd None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.005364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032cd70-7a92-456e-8110-87fc37df7bbc None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.032855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9ba53-5f7a-4130-b40c-e0e25eeeae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.033495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9ba53-5f7a-4130-b40c-e0e25eeeae63 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.033792 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9ba53-5f7a-4130-b40c-e0e25eeeae63 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.034061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9ba53-5f7a-4130-b40c-e0e25eeeae63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.040905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a98d7-bacb-4fee-9c75-0fb61b8d1abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.041571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a98d7-bacb-4fee-9c75-0fb61b8d1abb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.041858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a98d7-bacb-4fee-9c75-0fb61b8d1abb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.042130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a98d7-bacb-4fee-9c75-0fb61b8d1abb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.044419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9ba53-5f7a-4130-b40c-e0e25eeeae63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.045880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9ba53-5f7a-4130-b40c-e0e25eeeae63 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.053304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a98d7-bacb-4fee-9c75-0fb61b8d1abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-018a98d7-bacb-4fee-9c75-0fb61b8d1abb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:28.059269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:28.060173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:28.061014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 288/573] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:28.062295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a98d7-bacb-4fee-9c75-0fb61b8d1abb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-8ab9ba53-5f7a-4130-b40c-e0e25eeeae63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:28.066142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:28.067675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:28.068647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:28.068647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:28.068647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:28.068647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 286/574] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:28.070335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9ba53-5f7a-4130-b40c-e0e25eeeae63 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.127667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.172617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a98d7-bacb-4fee-9c75-0fb61b8d1abb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.181613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9ba53-5f7a-4130-b40c-e0e25eeeae63 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.183515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.207028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97f144-dd52-45dd-890c-c73e4a85151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.207696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f144-dd52-45dd-890c-c73e4a85151c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.208046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f144-dd52-45dd-890c-c73e4a85151c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.208318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97f144-dd52-45dd-890c-c73e4a85151c None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.208975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97f144-dd52-45dd-890c-c73e4a85151c None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:28.209270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97f144-dd52-45dd-890c-c73e4a85151c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.210660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97f144-dd52-45dd-890c-c73e4a85151c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.217853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d234-6d0a-4cbe-9c33-eb273b08e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.218472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d234-6d0a-4cbe-9c33-eb273b08e74e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.218746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d234-6d0a-4cbe-9c33-eb273b08e74e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.219013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d234-6d0a-4cbe-9c33-eb273b08e74e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.224707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 289/575] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:28.224707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97f144-dd52-45dd-890c-c73e4a85151c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.235132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d234-6d0a-4cbe-9c33-eb273b08e74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.236608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d234-6d0a-4cbe-9c33-eb273b08e74e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f0f5d234-6d0a-4cbe-9c33-eb273b08e74e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:28.250601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:28.251551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:28.252976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:28.252976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:28.252976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:28.252976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 287/576] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:28.253215 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d234-6d0a-4cbe-9c33-eb273b08e74e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.340649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97f144-dd52-45dd-890c-c73e4a85151c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.356854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.360281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d234-6d0a-4cbe-9c33-eb273b08e74e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.379344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e1962-c56b-4f3f-8395-8b7bbf969325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.379960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e1962-c56b-4f3f-8395-8b7bbf969325 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.380240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e1962-c56b-4f3f-8395-8b7bbf969325 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.380514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e1962-c56b-4f3f-8395-8b7bbf969325 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.381190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e1962-c56b-4f3f-8395-8b7bbf969325 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:28.381519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e1962-c56b-4f3f-8395-8b7bbf969325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.382912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e1962-c56b-4f3f-8395-8b7bbf969325 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.397307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 290/577] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:28.397307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e1962-c56b-4f3f-8395-8b7bbf969325 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.406758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e1583-42c1-4ace-a937-bc4d8fc0dade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.407568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e1583-42c1-4ace-a937-bc4d8fc0dade None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.408152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e1583-42c1-4ace-a937-bc4d8fc0dade None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.409641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e1583-42c1-4ace-a937-bc4d8fc0dade None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.410795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e1583-42c1-4ace-a937-bc4d8fc0dade None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:28.411596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e1583-42c1-4ace-a937-bc4d8fc0dade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.413657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e1583-42c1-4ace-a937-bc4d8fc0dade None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.429777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 288/578] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:28.431705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e1583-42c1-4ace-a937-bc4d8fc0dade None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.438649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.503823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e1962-c56b-4f3f-8395-8b7bbf969325 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.538670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00648167-2d36-4daa-971b-4c18afb17b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.539292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00648167-2d36-4daa-971b-4c18afb17b13 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.539569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00648167-2d36-4daa-971b-4c18afb17b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.539836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00648167-2d36-4daa-971b-4c18afb17b13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.546689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e1583-42c1-4ace-a937-bc4d8fc0dade None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.550953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00648167-2d36-4daa-971b-4c18afb17b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.552385 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00648167-2d36-4daa-971b-4c18afb17b13 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-00648167-2d36-4daa-971b-4c18afb17b13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:28.569872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:28.575666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:28.576834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:28.576834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:28.576834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:28.576834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 291/579] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:28.576834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00648167-2d36-4daa-971b-4c18afb17b13 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.588585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44bda-232b-491d-a991-168a2011da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.589184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44bda-232b-491d-a991-168a2011da7e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.589485 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44bda-232b-491d-a991-168a2011da7e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.589753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44bda-232b-491d-a991-168a2011da7e None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.590388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d44bda-232b-491d-a991-168a2011da7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:28.590687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d44bda-232b-491d-a991-168a2011da7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.592023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d44bda-232b-491d-a991-168a2011da7e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.603536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 289/580] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:28.604311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44bda-232b-491d-a991-168a2011da7e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.626081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.687608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.704412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00648167-2d36-4daa-971b-4c18afb17b13 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.708715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d44bda-232b-491d-a991-168a2011da7e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.741267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1915e-1bf8-42dc-987f-ce4bc04e462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.741937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1915e-1bf8-42dc-987f-ce4bc04e462f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.742211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1915e-1bf8-42dc-987f-ce4bc04e462f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.742778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1915e-1bf8-42dc-987f-ce4bc04e462f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.745872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b8fbe-8298-4865-9997-68675f27d915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.746495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b8fbe-8298-4865-9997-68675f27d915 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.746769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b8fbe-8298-4865-9997-68675f27d915 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.747037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b8fbe-8298-4865-9997-68675f27d915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.755021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b8fbe-8298-4865-9997-68675f27d915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.755513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1915e-1bf8-42dc-987f-ce4bc04e462f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.756393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b8fbe-8298-4865-9997-68675f27d915 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.756943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1915e-1bf8-42dc-987f-ce4bc04e462f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-b52b8fbe-8298-4865-9997-68675f27d915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:28.771248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:28.772182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:28.773096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:28.773096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:28.773096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:28.773096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:28.773096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:28.773096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:28.773096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:28.773096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-0ae1915e-1bf8-42dc-987f-ce4bc04e462f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:28.774071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:28.774996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:28.775901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:28.775901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:28.775901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:28.775901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 292/581] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:28.775901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1915e-1bf8-42dc-987f-ce4bc04e462f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.777240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 290/582] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:28.777793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b8fbe-8298-4865-9997-68675f27d915 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.871276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.886722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1915e-1bf8-42dc-987f-ce4bc04e462f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.890739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b8fbe-8298-4865-9997-68675f27d915 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:28.923145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bd447-96b9-464f-bd48-1b22bc0b5c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.923747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bd447-96b9-464f-bd48-1b22bc0b5c7e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.924023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bd447-96b9-464f-bd48-1b22bc0b5c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.924884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bd447-96b9-464f-bd48-1b22bc0b5c7e None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.925544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bd447-96b9-464f-bd48-1b22bc0b5c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:28.925850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bd447-96b9-464f-bd48-1b22bc0b5c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.926907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee8335-7e35-4720-abce-12b54a72bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:28.927200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bd447-96b9-464f-bd48-1b22bc0b5c7e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.927529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee8335-7e35-4720-abce-12b54a72bf31 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:28.927799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee8335-7e35-4720-abce-12b54a72bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:28.928063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee8335-7e35-4720-abce-12b54a72bf31 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:28.935115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:28.935613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee8335-7e35-4720-abce-12b54a72bf31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:28.937032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee8335-7e35-4720-abce-12b54a72bf31 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:28.944660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 293/583] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:28.944660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bd447-96b9-464f-bd48-1b22bc0b5c7e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-02ee8335-7e35-4720-abce-12b54a72bf31 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:28.950418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:28.951386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:28.952390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 291/584] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:28.952985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee8335-7e35-4720-abce-12b54a72bf31 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.058328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bd447-96b9-464f-bd48-1b22bc0b5c7e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.069650 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee8335-7e35-4720-abce-12b54a72bf31 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.097228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4ed35-dc4d-43ce-82c7-e8b00c3d1640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.097867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4ed35-dc4d-43ce-82c7-e8b00c3d1640 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.098142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4ed35-dc4d-43ce-82c7-e8b00c3d1640 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.098384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4ed35-dc4d-43ce-82c7-e8b00c3d1640 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.099058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4ed35-dc4d-43ce-82c7-e8b00c3d1640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:29.099362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4ed35-dc4d-43ce-82c7-e8b00c3d1640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.100770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4ed35-dc4d-43ce-82c7-e8b00c3d1640 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.104894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d8791-9f5e-4140-8c01-c46d6fde8cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.105512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d8791-9f5e-4140-8c01-c46d6fde8cff None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.105871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d8791-9f5e-4140-8c01-c46d6fde8cff None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.106147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d8791-9f5e-4140-8c01-c46d6fde8cff None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.106787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d8791-9f5e-4140-8c01-c46d6fde8cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:29.107086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d8791-9f5e-4140-8c01-c46d6fde8cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.108430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d8791-9f5e-4140-8c01-c46d6fde8cff None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.118231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 294/585] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:29.118231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4ed35-dc4d-43ce-82c7-e8b00c3d1640 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.121028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.124442 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 292/586] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:29.126371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d8791-9f5e-4140-8c01-c46d6fde8cff None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.186063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.231390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4ed35-dc4d-43ce-82c7-e8b00c3d1640 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.240211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d8791-9f5e-4140-8c01-c46d6fde8cff None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.266077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2333-2194-42b9-9fa7-dbd9779c766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.266701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2333-2194-42b9-9fa7-dbd9779c766f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.266976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2333-2194-42b9-9fa7-dbd9779c766f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.267239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2333-2194-42b9-9fa7-dbd9779c766f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.275672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f2333-2194-42b9-9fa7-dbd9779c766f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.275944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f9fc6-7bea-40ea-9309-79742ddfac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.276545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f9fc6-7bea-40ea-9309-79742ddfac12 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.276820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f9fc6-7bea-40ea-9309-79742ddfac12 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.277089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f9fc6-7bea-40ea-9309-79742ddfac12 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.277194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f2333-2194-42b9-9fa7-dbd9779c766f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.277849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f9fc6-7bea-40ea-9309-79742ddfac12 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:29.278155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f9fc6-7bea-40ea-9309-79742ddfac12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.279586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f9fc6-7bea-40ea-9309-79742ddfac12 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-003f2333-2194-42b9-9fa7-dbd9779c766f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:29.289190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:29.290299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 295/587] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:29.291223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2333-2194-42b9-9fa7-dbd9779c766f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.303582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 293/588] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:29.305057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f9fc6-7bea-40ea-9309-79742ddfac12 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.362953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.393950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2333-2194-42b9-9fa7-dbd9779c766f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.405049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f9fc6-7bea-40ea-9309-79742ddfac12 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.411546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.428078 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417d4cd-8405-4efe-926c-aba6e707ca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.430285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417d4cd-8405-4efe-926c-aba6e707ca8e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.430285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417d4cd-8405-4efe-926c-aba6e707ca8e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.430285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417d4cd-8405-4efe-926c-aba6e707ca8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.430285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417d4cd-8405-4efe-926c-aba6e707ca8e None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=f362b8daae13435a9a468b06c4998c67) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:29.430285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417d4cd-8405-4efe-926c-aba6e707ca8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.431731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417d4cd-8405-4efe-926c-aba6e707ca8e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.436986 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 296/589] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/role_assignments?user.id=f362b8daae13435a9a468b06c4998c67&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:29.437786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417d4cd-8405-4efe-926c-aba6e707ca8e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.439467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea0647-52b0-4d86-8c04-2757017c4463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.440207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea0647-52b0-4d86-8c04-2757017c4463 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.440490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea0647-52b0-4d86-8c04-2757017c4463 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.440764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea0647-52b0-4d86-8c04-2757017c4463 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.453602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea0647-52b0-4d86-8c04-2757017c4463 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.455087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea0647-52b0-4d86-8c04-2757017c4463 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-9dea0647-52b0-4d86-8c04-2757017c4463 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:29.469138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:29.470239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:29.472094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 294/590] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:29.473046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fcd9c-fab5-4f5d-9a6d-94bd0e832b8c None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.473046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fcd9c-fab5-4f5d-9a6d-94bd0e832b8c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.473046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fcd9c-fab5-4f5d-9a6d-94bd0e832b8c None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.479039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 295/591] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:29.479039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fcd9c-fab5-4f5d-9a6d-94bd0e832b8c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.570093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417d4cd-8405-4efe-926c-aba6e707ca8e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.603620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fcd9c-fab5-4f5d-9a6d-94bd0e832b8c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.621835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.628805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2a3aa-b4b5-454a-973d-ab4922ed901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.629498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2a3aa-b4b5-454a-973d-ab4922ed901d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.629782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2a3aa-b4b5-454a-973d-ab4922ed901d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.630047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2a3aa-b4b5-454a-973d-ab4922ed901d None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.630779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2a3aa-b4b5-454a-973d-ab4922ed901d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:29.631069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2a3aa-b4b5-454a-973d-ab4922ed901d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.632540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2a3aa-b4b5-454a-973d-ab4922ed901d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.639164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5af677-9e7a-42ff-b759-a8f6e5787d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.639798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5af677-9e7a-42ff-b759-a8f6e5787d66 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.640078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5af677-9e7a-42ff-b759-a8f6e5787d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.640352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5af677-9e7a-42ff-b759-a8f6e5787d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.651661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5af677-9e7a-42ff-b759-a8f6e5787d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.653097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5af677-9e7a-42ff-b759-a8f6e5787d66 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.655997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 297/592] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:29.656700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2a3aa-b4b5-454a-973d-ab4922ed901d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0a5af677-9e7a-42ff-b759-a8f6e5787d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:29.668932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:29.670033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:29.670945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:29.670945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:29.670945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:29.670945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 296/593] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:29.671185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106d38-ca9b-4c66-a22a-d889984b970c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.671562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106d38-ca9b-4c66-a22a-d889984b970c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.671727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106d38-ca9b-4c66-a22a-d889984b970c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.690237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cf106d38-ca9b-4c66-a22a-d889984b970c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:29.691962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cf106d38-ca9b-4c66-a22a-d889984b970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:29.711410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.773942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 297/594] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:29.774480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2a3aa-b4b5-454a-973d-ab4922ed901d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.775558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106d38-ca9b-4c66-a22a-d889984b970c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.818677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c90aa-d357-413a-8c31-deffe8b85e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.819630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c90aa-d357-413a-8c31-deffe8b85e26 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.820001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c90aa-d357-413a-8c31-deffe8b85e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.820365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c90aa-d357-413a-8c31-deffe8b85e26 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.821212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c90aa-d357-413a-8c31-deffe8b85e26 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:29.821658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c90aa-d357-413a-8c31-deffe8b85e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.823167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c90aa-d357-413a-8c31-deffe8b85e26 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.842900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 298/595] 10.222.0.58 () {56 vars in 1139 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:29.843757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c90aa-d357-413a-8c31-deffe8b85e26 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:29.931547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106d38-ca9b-4c66-a22a-d889984b970c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.939836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:29.966326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71181b91-150d-4314-8652-e74849121310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:29.966637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c90aa-d357-413a-8c31-deffe8b85e26 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:29.967213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71181b91-150d-4314-8652-e74849121310 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:29.967584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71181b91-150d-4314-8652-e74849121310 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:29.967947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71181b91-150d-4314-8652-e74849121310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:29.981043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71181b91-150d-4314-8652-e74849121310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:29.982708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71181b91-150d-4314-8652-e74849121310 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:29.986196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-71181b91-150d-4314-8652-e74849121310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:30.002410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:30.005409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:30.006635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:30.006635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:30.006635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:30.006635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 298/596] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:30.006635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71181b91-150d-4314-8652-e74849121310 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.008497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0e528-3ada-4413-b5c3-cf46e1d2799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.009158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0e528-3ada-4413-b5c3-cf46e1d2799f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.009435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0e528-3ada-4413-b5c3-cf46e1d2799f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.009725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0e528-3ada-4413-b5c3-cf46e1d2799f None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.010422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0e528-3ada-4413-b5c3-cf46e1d2799f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:30.011662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0e528-3ada-4413-b5c3-cf46e1d2799f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.013126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0e528-3ada-4413-b5c3-cf46e1d2799f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.028354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 299/597] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:30.029521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0e528-3ada-4413-b5c3-cf46e1d2799f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.122249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71181b91-150d-4314-8652-e74849121310 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.143446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0e528-3ada-4413-b5c3-cf46e1d2799f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.158034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00953cc-c899-4efd-9adc-233b2f37136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.159268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00953cc-c899-4efd-9adc-233b2f37136d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.159548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00953cc-c899-4efd-9adc-233b2f37136d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.159803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00953cc-c899-4efd-9adc-233b2f37136d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.170448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00953cc-c899-4efd-9adc-233b2f37136d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.171889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00953cc-c899-4efd-9adc-233b2f37136d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.184691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf6892-7b81-45e6-b95f-4e190e768228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.185279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf6892-7b81-45e6-b95f-4e190e768228 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.185601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf6892-7b81-45e6-b95f-4e190e768228 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.185875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf6892-7b81-45e6-b95f-4e190e768228 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.186552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf6892-7b81-45e6-b95f-4e190e768228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:30.186927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf6892-7b81-45e6-b95f-4e190e768228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.188292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf6892-7b81-45e6-b95f-4e190e768228 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-c00953cc-c899-4efd-9adc-233b2f37136d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:30.191895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:30.192813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:30.193831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:30.193831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:30.193831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:30.197610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 299/598] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:30.198439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00953cc-c899-4efd-9adc-233b2f37136d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.202826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.204846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 300/599] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:30.206112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf6892-7b81-45e6-b95f-4e190e768228 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.229880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.308806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00953cc-c899-4efd-9adc-233b2f37136d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.317627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf6892-7b81-45e6-b95f-4e190e768228 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.351042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793b043-82ce-4b79-8ca6-75e8f4393e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.351667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793b043-82ce-4b79-8ca6-75e8f4393e88 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.351941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793b043-82ce-4b79-8ca6-75e8f4393e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.352205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793b043-82ce-4b79-8ca6-75e8f4393e88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.356776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81249e4f-889f-4e48-8088-78b23ddd2e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.357402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81249e4f-889f-4e48-8088-78b23ddd2e5d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.357705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81249e4f-889f-4e48-8088-78b23ddd2e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.357970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81249e4f-889f-4e48-8088-78b23ddd2e5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.359049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793b043-82ce-4b79-8ca6-75e8f4393e88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.360938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793b043-82ce-4b79-8ca6-75e8f4393e88 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d793b043-82ce-4b79-8ca6-75e8f4393e88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:30.373246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:30.374364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:30.375282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:30.375282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:30.375282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:30.375282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:30.375282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:30.375282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:30.375282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:30.375282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:30.375282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 300/600] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:30.375779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793b043-82ce-4b79-8ca6-75e8f4393e88 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.376380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81249e4f-889f-4e48-8088-78b23ddd2e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-81249e4f-889f-4e48-8088-78b23ddd2e5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:30.381315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:30.382464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:30.383569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:30.387071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 301/601] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:30.387892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81249e4f-889f-4e48-8088-78b23ddd2e5d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.451556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.474976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.493066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793b043-82ce-4b79-8ca6-75e8f4393e88 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.498628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81249e4f-889f-4e48-8088-78b23ddd2e5d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.525919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aac46b-b625-4816-8859-fe9cfac9b0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.526490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aac46b-b625-4816-8859-fe9cfac9b0fc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.526763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aac46b-b625-4816-8859-fe9cfac9b0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.527028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aac46b-b625-4816-8859-fe9cfac9b0fc None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.527665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aac46b-b625-4816-8859-fe9cfac9b0fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:30.527960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aac46b-b625-4816-8859-fe9cfac9b0fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.529304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aac46b-b625-4816-8859-fe9cfac9b0fc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.537863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d800165-b14d-4907-8b56-13b07be11903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.538836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d800165-b14d-4907-8b56-13b07be11903 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.539456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d800165-b14d-4907-8b56-13b07be11903 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.539730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d800165-b14d-4907-8b56-13b07be11903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.542881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 301/602] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:30.544011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aac46b-b625-4816-8859-fe9cfac9b0fc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.552230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d800165-b14d-4907-8b56-13b07be11903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.553845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d800165-b14d-4907-8b56-13b07be11903 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2d800165-b14d-4907-8b56-13b07be11903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:30.567363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:30.568276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:30.569203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:30.569203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:30.569203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:30.569203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:30.569203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:30.569203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:30.569203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:30.569203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:30.569203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 302/603] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:30.570235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d800165-b14d-4907-8b56-13b07be11903 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.651118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aac46b-b625-4816-8859-fe9cfac9b0fc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.673347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d800165-b14d-4907-8b56-13b07be11903 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.679516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.690730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc495b14-ec00-493d-afc7-f3d034c32b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.691438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc495b14-ec00-493d-afc7-f3d034c32b30 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.691709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc495b14-ec00-493d-afc7-f3d034c32b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.692032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc495b14-ec00-493d-afc7-f3d034c32b30 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.692715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc495b14-ec00-493d-afc7-f3d034c32b30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:30.693102 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc495b14-ec00-493d-afc7-f3d034c32b30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.694852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc495b14-ec00-493d-afc7-f3d034c32b30 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.708113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c458f-fb69-4947-867e-b5b0f62fd29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.708672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c458f-fb69-4947-867e-b5b0f62fd29e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.708998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c458f-fb69-4947-867e-b5b0f62fd29e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.709269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c458f-fb69-4947-867e-b5b0f62fd29e None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.709970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c458f-fb69-4947-867e-b5b0f62fd29e None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:30.710264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c458f-fb69-4947-867e-b5b0f62fd29e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.711608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c458f-fb69-4947-867e-b5b0f62fd29e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.713685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 302/604] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:30.714597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc495b14-ec00-493d-afc7-f3d034c32b30 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.716928 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.725182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 303/605] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:30.725182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c458f-fb69-4947-867e-b5b0f62fd29e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.824207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc495b14-ec00-493d-afc7-f3d034c32b30 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.827132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c458f-fb69-4947-867e-b5b0f62fd29e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.860206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db69eb-be16-47dd-9fee-905586861052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.860916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db69eb-be16-47dd-9fee-905586861052 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.861260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db69eb-be16-47dd-9fee-905586861052 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.862321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db69eb-be16-47dd-9fee-905586861052 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.863148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2551-92d3-44d9-95ca-df861d2cf28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:30.863750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2551-92d3-44d9-95ca-df861d2cf28c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:30.864027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2551-92d3-44d9-95ca-df861d2cf28c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:30.864298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2551-92d3-44d9-95ca-df861d2cf28c None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:30.864970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed2551-92d3-44d9-95ca-df861d2cf28c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:30.865364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed2551-92d3-44d9-95ca-df861d2cf28c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.866706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed2551-92d3-44d9-95ca-df861d2cf28c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.869646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db69eb-be16-47dd-9fee-905586861052 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:30.871068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db69eb-be16-47dd-9fee-905586861052 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:30.884190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 304/606] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:30.884190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2551-92d3-44d9-95ca-df861d2cf28c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-e1db69eb-be16-47dd-9fee-905586861052 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:30.884476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:30.885348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 303/607] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:30.886786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db69eb-be16-47dd-9fee-905586861052 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:30.940622 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.952415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:30.994057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db69eb-be16-47dd-9fee-905586861052 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:30.994235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2551-92d3-44d9-95ca-df861d2cf28c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.028732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8fcde-7260-4488-8178-915754e5f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.028937 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861168ec-aedb-41a5-b65d-2d9fb23e2239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.029394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8fcde-7260-4488-8178-915754e5f45f None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.029513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861168ec-aedb-41a5-b65d-2d9fb23e2239 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.029711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8fcde-7260-4488-8178-915754e5f45f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.029806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861168ec-aedb-41a5-b65d-2d9fb23e2239 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.029975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8fcde-7260-4488-8178-915754e5f45f None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/79bb81300cff46b7ba1680eedf2762cf/roles/812d9626de92430d9cef17f80d5a1b4e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.030079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861168ec-aedb-41a5-b65d-2d9fb23e2239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.041846 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861168ec-aedb-41a5-b65d-2d9fb23e2239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.043311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861168ec-aedb-41a5-b65d-2d9fb23e2239 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.046157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8fcde-7260-4488-8178-915754e5f45f None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=79bb81300cff46b7ba1680eedf2762cf, role_id=812d9626de92430d9cef17f80d5a1b4e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.047590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8fcde-7260-4488-8178-915754e5f45f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-861168ec-aedb-41a5-b65d-2d9fb23e2239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:31.058514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:31.065254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:31.066557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:31.066557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:31.066557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:31.066557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 304/608] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:31.066557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861168ec-aedb-41a5-b65d-2d9fb23e2239 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.164363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:31.170498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861168ec-aedb-41a5-b65d-2d9fb23e2239 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.185501 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 305/609] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:30 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/79bb81300cff46b7ba1680eedf2762cf/roles/812d9626de92430d9cef17f80d5a1b4e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:31.185501 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8fcde-7260-4488-8178-915754e5f45f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.228211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8f842-101c-4120-a27c-23ff6452bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.228969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8f842-101c-4120-a27c-23ff6452bab2 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.229256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8f842-101c-4120-a27c-23ff6452bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.233788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8f842-101c-4120-a27c-23ff6452bab2 None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/23734a2b701a46c3a25ae547aff98026/roles/812d9626de92430d9cef17f80d5a1b4e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.260265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8f842-101c-4120-a27c-23ff6452bab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=23734a2b701a46c3a25ae547aff98026, role_id=812d9626de92430d9cef17f80d5a1b4e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.261876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8f842-101c-4120-a27c-23ff6452bab2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.302691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8fcde-7260-4488-8178-915754e5f45f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.321159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:31.348682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebba31-0983-49a4-82c1-73ba0b5ac9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.349321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebba31-0983-49a4-82c1-73ba0b5ac9fb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.349624 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebba31-0983-49a4-82c1-73ba0b5ac9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.349891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebba31-0983-49a4-82c1-73ba0b5ac9fb None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.350587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebba31-0983-49a4-82c1-73ba0b5ac9fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:31.350884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebba31-0983-49a4-82c1-73ba0b5ac9fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.352315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebba31-0983-49a4-82c1-73ba0b5ac9fb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.366626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 306/610] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:31.367650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebba31-0983-49a4-82c1-73ba0b5ac9fb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.377877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 305/611] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:31 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/23734a2b701a46c3a25ae547aff98026/roles/812d9626de92430d9cef17f80d5a1b4e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:31.379021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8f842-101c-4120-a27c-23ff6452bab2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.499167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebba31-0983-49a4-82c1-73ba0b5ac9fb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.515023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8f842-101c-4120-a27c-23ff6452bab2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.548837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042aa442-1e23-464f-a88c-651913f405be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.549667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aa442-1e23-464f-a88c-651913f405be None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.550094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aa442-1e23-464f-a88c-651913f405be None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.551855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042aa442-1e23-464f-a88c-651913f405be None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.552524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aa442-1e23-464f-a88c-651913f405be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:31.552823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aa442-1e23-464f-a88c-651913f405be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.555123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042aa442-1e23-464f-a88c-651913f405be None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.563315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385dbf2-eecf-4747-a55e-2b805fcb48b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.564261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385dbf2-eecf-4747-a55e-2b805fcb48b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.565152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385dbf2-eecf-4747-a55e-2b805fcb48b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.565417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385dbf2-eecf-4747-a55e-2b805fcb48b1 None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/321d07f93b7540128dc5415d8b3252c2/roles/812d9626de92430d9cef17f80d5a1b4e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.568550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 307/612] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:31.573110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a3433-4965-439b-bab0-36ea51f09a81 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.573110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a3433-4965-439b-bab0-36ea51f09a81 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.573110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a3433-4965-439b-bab0-36ea51f09a81 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.573110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 308/613] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:31.574546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a3433-4965-439b-bab0-36ea51f09a81 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.583497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385dbf2-eecf-4747-a55e-2b805fcb48b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=321d07f93b7540128dc5415d8b3252c2, role_id=812d9626de92430d9cef17f80d5a1b4e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.585291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385dbf2-eecf-4747-a55e-2b805fcb48b1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.590445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:31.609717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:31.660426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 306/614] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:31 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/321d07f93b7540128dc5415d8b3252c2/roles/812d9626de92430d9cef17f80d5a1b4e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:31.667129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafba4b-67ee-497a-8e66-2e14c69ede03 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.667129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafba4b-67ee-497a-8e66-2e14c69ede03 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.667402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafba4b-67ee-497a-8e66-2e14c69ede03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.706903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9eafba4b-67ee-497a-8e66-2e14c69ede03 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:31.707849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a3433-4965-439b-bab0-36ea51f09a81 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:31.709619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9eafba4b-67ee-497a-8e66-2e14c69ede03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:31.776930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb006c-067e-406f-ba2b-a3f237464b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:31.777497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb006c-067e-406f-ba2b-a3f237464b3a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:31.777784 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb006c-067e-406f-ba2b-a3f237464b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:31.778054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb006c-067e-406f-ba2b-a3f237464b3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:31.794715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb006c-067e-406f-ba2b-a3f237464b3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:31.796202 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb006c-067e-406f-ba2b-a3f237464b3a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-36eb006c-067e-406f-ba2b-a3f237464b3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:31.819721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:31.820927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:31.822091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:31.825022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 309/615] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 07:44:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:31.829357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb006c-067e-406f-ba2b-a3f237464b3a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:31.850641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 307/616] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:31.959237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:31.969158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb006c-067e-406f-ba2b-a3f237464b3a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.012994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28220a13-373b-4eeb-86c3-a040ddde0581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.013636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28220a13-373b-4eeb-86c3-a040ddde0581 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.013914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28220a13-373b-4eeb-86c3-a040ddde0581 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.014185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28220a13-373b-4eeb-86c3-a040ddde0581 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.014921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28220a13-373b-4eeb-86c3-a040ddde0581 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:32.015225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28220a13-373b-4eeb-86c3-a040ddde0581 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:32.016654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28220a13-373b-4eeb-86c3-a040ddde0581 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:32.040765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 310/617] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 07:44:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:32.046271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafba4b-67ee-497a-8e66-2e14c69ede03 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.175334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28220a13-373b-4eeb-86c3-a040ddde0581 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.222537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafba4b-67ee-497a-8e66-2e14c69ede03 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.269826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.287768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d8719-36dd-45b2-aac3-eaca568a2279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.288585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d8719-36dd-45b2-aac3-eaca568a2279 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.291635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d8719-36dd-45b2-aac3-eaca568a2279 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.291635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d8719-36dd-45b2-aac3-eaca568a2279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.348885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28220a13-373b-4eeb-86c3-a040ddde0581 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.400940 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d8719-36dd-45b2-aac3-eaca568a2279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:32.402580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d8719-36dd-45b2-aac3-eaca568a2279 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:32.437334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d2ee4-21dc-4ff6-90a9-419e2307c8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.438040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d2ee4-21dc-4ff6-90a9-419e2307c8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.438324 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d2ee4-21dc-4ff6-90a9-419e2307c8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.438596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d2ee4-21dc-4ff6-90a9-419e2307c8a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.466755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d2ee4-21dc-4ff6-90a9-419e2307c8a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9b9d2ee4-21dc-4ff6-90a9-419e2307c8a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:32.471760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:32.472805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:32.473681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:32.480766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 311/618] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:32.481657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d2ee4-21dc-4ff6-90a9-419e2307c8a8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.504343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.578700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 308/619] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:32.580597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d8719-36dd-45b2-aac3-eaca568a2279 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.644886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.665891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d2ee4-21dc-4ff6-90a9-419e2307c8a8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.703827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e2800-3d51-4d6b-ae15-2dee90bc56fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.704580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e2800-3d51-4d6b-ae15-2dee90bc56fc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.704864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e2800-3d51-4d6b-ae15-2dee90bc56fc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.705166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e2800-3d51-4d6b-ae15-2dee90bc56fc None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.706654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e2800-3d51-4d6b-ae15-2dee90bc56fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:32.706961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e2800-3d51-4d6b-ae15-2dee90bc56fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:32.708491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e2800-3d51-4d6b-ae15-2dee90bc56fc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:32.718040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 312/620] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:32.723940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e2800-3d51-4d6b-ae15-2dee90bc56fc None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.799159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:32.833673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e2800-3d51-4d6b-ae15-2dee90bc56fc None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.870942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb2759-5e63-4956-b9be-5884ca76171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.871778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb2759-5e63-4956-b9be-5884ca76171b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.872158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb2759-5e63-4956-b9be-5884ca76171b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.872554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb2759-5e63-4956-b9be-5884ca76171b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.883321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d8719-36dd-45b2-aac3-eaca568a2279 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:32.885573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb2759-5e63-4956-b9be-5884ca76171b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:32.887137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb2759-5e63-4956-b9be-5884ca76171b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-0ebb2759-5e63-4956-b9be-5884ca76171b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:32.904384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:32.905394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:32.906338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:32.906338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:32.906338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:32.906338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 313/621] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:32.913609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb2759-5e63-4956-b9be-5884ca76171b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:32.953368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530263a3-35a8-48fe-a76d-712eb5b431be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:32.954019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530263a3-35a8-48fe-a76d-712eb5b431be None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:32.954287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530263a3-35a8-48fe-a76d-712eb5b431be None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:32.954552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530263a3-35a8-48fe-a76d-712eb5b431be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:32.969092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530263a3-35a8-48fe-a76d-712eb5b431be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:32.970556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530263a3-35a8-48fe-a76d-712eb5b431be None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-530263a3-35a8-48fe-a76d-712eb5b431be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:32.996815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:32.997877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:32.998793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:32.998793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:32.998793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:32.999380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 309/622] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:33.009798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530263a3-35a8-48fe-a76d-712eb5b431be None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.098413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb2759-5e63-4956-b9be-5884ca76171b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.141815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.161599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.178737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ecd61-cb67-4908-818d-8216bf7e77cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.179367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ecd61-cb67-4908-818d-8216bf7e77cd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.179646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ecd61-cb67-4908-818d-8216bf7e77cd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.179917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ecd61-cb67-4908-818d-8216bf7e77cd None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.180577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ecd61-cb67-4908-818d-8216bf7e77cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:33.180881 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ecd61-cb67-4908-818d-8216bf7e77cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.182753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ecd61-cb67-4908-818d-8216bf7e77cd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.185539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530263a3-35a8-48fe-a76d-712eb5b431be None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.211893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 314/623] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:33.217917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ecd61-cb67-4908-818d-8216bf7e77cd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.242014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47f289-2960-4ccc-a874-46402b2c0771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.244045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47f289-2960-4ccc-a874-46402b2c0771 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.244378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47f289-2960-4ccc-a874-46402b2c0771 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.244654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47f289-2960-4ccc-a874-46402b2c0771 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.245309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47f289-2960-4ccc-a874-46402b2c0771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:33.246479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47f289-2960-4ccc-a874-46402b2c0771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.248915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47f289-2960-4ccc-a874-46402b2c0771 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.273985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 310/624] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:33.279738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47f289-2960-4ccc-a874-46402b2c0771 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.385154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ecd61-cb67-4908-818d-8216bf7e77cd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.419694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47f289-2960-4ccc-a874-46402b2c0771 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.421082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05249a-728b-4034-a428-81e15ef83b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.421996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05249a-728b-4034-a428-81e15ef83b14 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.422536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05249a-728b-4034-a428-81e15ef83b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.423006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05249a-728b-4034-a428-81e15ef83b14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.431451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05249a-728b-4034-a428-81e15ef83b14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.433164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05249a-728b-4034-a428-81e15ef83b14 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2c05249a-728b-4034-a428-81e15ef83b14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:33.445310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:33.446349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:33.447330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:33.449888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 315/625] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:33.451330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051ab9-3a8d-4a60-a843-ef17311f8ede None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.451820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051ab9-3a8d-4a60-a843-ef17311f8ede None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.452293 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051ab9-3a8d-4a60-a843-ef17311f8ede None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.454055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 316/626] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:33.456152 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051ab9-3a8d-4a60-a843-ef17311f8ede None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.462876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0fa14-9dc8-4596-b28d-4b3fa5ffef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.463523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0fa14-9dc8-4596-b28d-4b3fa5ffef0d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.463802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0fa14-9dc8-4596-b28d-4b3fa5ffef0d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.464075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0fa14-9dc8-4596-b28d-4b3fa5ffef0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.473059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0fa14-9dc8-4596-b28d-4b3fa5ffef0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.474884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0fa14-9dc8-4596-b28d-4b3fa5ffef0d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-86d0fa14-9dc8-4596-b28d-4b3fa5ffef0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:33.490169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:33.491164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:33.492719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:33.492719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:33.492719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:33.492719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:33.492719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:33.492719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:33.492719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:33.492719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:33.492719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 311/627] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:33.493242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f616e-6027-412a-8c05-ebf11cf13c26 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.493242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f616e-6027-412a-8c05-ebf11cf13c26 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.493380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f616e-6027-412a-8c05-ebf11cf13c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.512211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.514938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9a1f616e-6027-412a-8c05-ebf11cf13c26 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:33.516142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9a1f616e-6027-412a-8c05-ebf11cf13c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:33.527345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.580646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051ab9-3a8d-4a60-a843-ef17311f8ede None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.589078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 312/628] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:33.589958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f616e-6027-412a-8c05-ebf11cf13c26 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.627039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e31792-5b22-4da4-b158-5905f58e7e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.628325 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31792-5b22-4da4-b158-5905f58e7e4a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.628997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31792-5b22-4da4-b158-5905f58e7e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.629417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e31792-5b22-4da4-b158-5905f58e7e4a None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.630581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e31792-5b22-4da4-b158-5905f58e7e4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:33.631435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e31792-5b22-4da4-b158-5905f58e7e4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.633310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e31792-5b22-4da4-b158-5905f58e7e4a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.661798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 317/629] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:33.661798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa06ea-ea83-48a9-aee8-2fa3392c6b6d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.661798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa06ea-ea83-48a9-aee8-2fa3392c6b6d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.661798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa06ea-ea83-48a9-aee8-2fa3392c6b6d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.663334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 318/630] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:33.664217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa06ea-ea83-48a9-aee8-2fa3392c6b6d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.726495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f616e-6027-412a-8c05-ebf11cf13c26 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.762109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.770242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:33.774259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa06ea-ea83-48a9-aee8-2fa3392c6b6d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:33.775324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f8f39-932e-4e49-878a-84119a6eed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.779984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f8f39-932e-4e49-878a-84119a6eed0e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.779984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f8f39-932e-4e49-878a-84119a6eed0e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.779984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f8f39-932e-4e49-878a-84119a6eed0e None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.779984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f8f39-932e-4e49-878a-84119a6eed0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:33.779984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f8f39-932e-4e49-878a-84119a6eed0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.780919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f8f39-932e-4e49-878a-84119a6eed0e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.800838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 313/631] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:33.802329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dfb9-4d16-4b91-a9d7-1cdf592ae0dc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.802742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dfb9-4d16-4b91-a9d7-1cdf592ae0dc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.803073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dfb9-4d16-4b91-a9d7-1cdf592ae0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.817575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1161f92-95f1-4d32-966c-a3ec34c89c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:33.818742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1161f92-95f1-4d32-966c-a3ec34c89c7c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:33.819169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1161f92-95f1-4d32-966c-a3ec34c89c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:33.819605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1161f92-95f1-4d32-966c-a3ec34c89c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:33.822108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4b79dfb9-4d16-4b91-a9d7-1cdf592ae0dc None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:33.823446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4b79dfb9-4d16-4b91-a9d7-1cdf592ae0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:33.832484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1161f92-95f1-4d32-966c-a3ec34c89c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:33.834282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1161f92-95f1-4d32-966c-a3ec34c89c7c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d1161f92-95f1-4d32-966c-a3ec34c89c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:33.850965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:33.852124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:33.853038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:33.853038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:33.853038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:33.854820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 319/632] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:33.855954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1161f92-95f1-4d32-966c-a3ec34c89c7c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.900606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 314/633] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:33.901711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79dfb9-4d16-4b91-a9d7-1cdf592ae0dc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:33.970352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1161f92-95f1-4d32-966c-a3ec34c89c7c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.016352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f0c8b-761f-449f-a6f5-9cdc5a8e241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.017215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f0c8b-761f-449f-a6f5-9cdc5a8e241a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.017510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f0c8b-761f-449f-a6f5-9cdc5a8e241a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.018365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f0c8b-761f-449f-a6f5-9cdc5a8e241a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.019395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f0c8b-761f-449f-a6f5-9cdc5a8e241a None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=6ef753445d864a0ab30ec970446b29cd) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:34.019700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f0c8b-761f-449f-a6f5-9cdc5a8e241a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.021834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f0c8b-761f-449f-a6f5-9cdc5a8e241a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.025856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79dfb9-4d16-4b91-a9d7-1cdf592ae0dc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.030173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 320/634] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/role_assignments?user.id=6ef753445d864a0ab30ec970446b29cd&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:34.030983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f0c8b-761f-449f-a6f5-9cdc5a8e241a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.054470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.066691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.105058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066d1ca-285d-47dc-9e82-d64a4cf5668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.106085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066d1ca-285d-47dc-9e82-d64a4cf5668b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.106620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066d1ca-285d-47dc-9e82-d64a4cf5668b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.106794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066d1ca-285d-47dc-9e82-d64a4cf5668b None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.107669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066d1ca-285d-47dc-9e82-d64a4cf5668b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:34.108020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066d1ca-285d-47dc-9e82-d64a4cf5668b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.109614 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066d1ca-285d-47dc-9e82-d64a4cf5668b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.136032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 315/635] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:34.141873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066d1ca-285d-47dc-9e82-d64a4cf5668b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.167357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f0c8b-761f-449f-a6f5-9cdc5a8e241a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.216855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf4bdc-3dbc-488d-9c40-2d0392536a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.218251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf4bdc-3dbc-488d-9c40-2d0392536a07 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.218251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf4bdc-3dbc-488d-9c40-2d0392536a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.218251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf4bdc-3dbc-488d-9c40-2d0392536a07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.234357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf4bdc-3dbc-488d-9c40-2d0392536a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-27bf4bdc-3dbc-488d-9c40-2d0392536a07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:34.239445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:34.240579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 321/636] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:34.241745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a875-0c14-4211-ae22-bf20f3ae7d3a None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.242651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a875-0c14-4211-ae22-bf20f3ae7d3a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.242651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a875-0c14-4211-ae22-bf20f3ae7d3a None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.248304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 322/637] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:34.249229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7a875-0c14-4211-ae22-bf20f3ae7d3a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.268787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066d1ca-285d-47dc-9e82-d64a4cf5668b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.308496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d8c2e-1c7a-4828-bd5d-2d257bbe7887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.309129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d8c2e-1c7a-4828-bd5d-2d257bbe7887 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.309404 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d8c2e-1c7a-4828-bd5d-2d257bbe7887 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.309702 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d8c2e-1c7a-4828-bd5d-2d257bbe7887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.319117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d8c2e-1c7a-4828-bd5d-2d257bbe7887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.320993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d8c2e-1c7a-4828-bd5d-2d257bbe7887 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-5b5d8c2e-1c7a-4828-bd5d-2d257bbe7887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:34.334244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:34.335525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 316/638] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:34.336668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29f20-452f-40df-9556-ebce7ead295f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.337418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29f20-452f-40df-9556-ebce7ead295f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.337418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d29f20-452f-40df-9556-ebce7ead295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.344500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.363195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d8d29f20-452f-40df-9556-ebce7ead295f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:34.365355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d8d29f20-452f-40df-9556-ebce7ead295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:34.370049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7a875-0c14-4211-ae22-bf20f3ae7d3a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.400044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.407559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa20bee-033d-4c12-8416-de6b1c7fb6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.408232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa20bee-033d-4c12-8416-de6b1c7fb6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.409090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa20bee-033d-4c12-8416-de6b1c7fb6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.409377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa20bee-033d-4c12-8416-de6b1c7fb6d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.420387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa20bee-033d-4c12-8416-de6b1c7fb6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9aa20bee-033d-4c12-8416-de6b1c7fb6d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:34.425689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:34.426924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 323/639] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:34.428091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa20bee-033d-4c12-8416-de6b1c7fb6d4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.452856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 317/640] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:34.452856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d29f20-452f-40df-9556-ebce7ead295f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.545641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa20bee-033d-4c12-8416-de6b1c7fb6d4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.576704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d29f20-452f-40df-9556-ebce7ead295f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.584851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bc89f-cbd7-4651-8bb0-bd644b016ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.585715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bc89f-cbd7-4651-8bb0-bd644b016ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.586225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bc89f-cbd7-4651-8bb0-bd644b016ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.586693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bc89f-cbd7-4651-8bb0-bd644b016ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.587524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bc89f-cbd7-4651-8bb0-bd644b016ac8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:34.588132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bc89f-cbd7-4651-8bb0-bd644b016ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.589708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bc89f-cbd7-4651-8bb0-bd644b016ac8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.592386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.603830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 324/641] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:34.604847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bc89f-cbd7-4651-8bb0-bd644b016ac8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.629157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfb9c1-7ae6-47cc-a75a-7a3a3be61428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.629803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfb9c1-7ae6-47cc-a75a-7a3a3be61428 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.630076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfb9c1-7ae6-47cc-a75a-7a3a3be61428 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.630340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfb9c1-7ae6-47cc-a75a-7a3a3be61428 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.631028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfb9c1-7ae6-47cc-a75a-7a3a3be61428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:34.631324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfb9c1-7ae6-47cc-a75a-7a3a3be61428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.632734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfb9c1-7ae6-47cc-a75a-7a3a3be61428 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.646850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 318/642] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:34.647654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfb9c1-7ae6-47cc-a75a-7a3a3be61428 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.679444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.742120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bc89f-cbd7-4651-8bb0-bd644b016ac8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.758957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfb9c1-7ae6-47cc-a75a-7a3a3be61428 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.779225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0ed1f-f017-4150-9afc-8804a8c39516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.780244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0ed1f-f017-4150-9afc-8804a8c39516 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.780531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0ed1f-f017-4150-9afc-8804a8c39516 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.780805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0ed1f-f017-4150-9afc-8804a8c39516 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.781486 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0ed1f-f017-4150-9afc-8804a8c39516 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:34.781791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0ed1f-f017-4150-9afc-8804a8c39516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.783205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0ed1f-f017-4150-9afc-8804a8c39516 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.796871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 325/643] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:34.796871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0ed1f-f017-4150-9afc-8804a8c39516 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.799762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202dc8-2be1-4de3-8f88-14d53468d82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.801247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202dc8-2be1-4de3-8f88-14d53468d82a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.801556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202dc8-2be1-4de3-8f88-14d53468d82a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.801826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202dc8-2be1-4de3-8f88-14d53468d82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.815227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6202dc8-2be1-4de3-8f88-14d53468d82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.817500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6202dc8-2be1-4de3-8f88-14d53468d82a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d6202dc8-2be1-4de3-8f88-14d53468d82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:34.835961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:34.837002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:34.838372 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:34.838372 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:34.838372 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:34.841597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 319/644] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:34.842872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202dc8-2be1-4de3-8f88-14d53468d82a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:34.862410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.907786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0ed1f-f017-4150-9afc-8804a8c39516 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.933604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:34.943578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59494a56-cdf9-44c1-8b92-ab3f638d4b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.944235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59494a56-cdf9-44c1-8b92-ab3f638d4b96 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.944512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59494a56-cdf9-44c1-8b92-ab3f638d4b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.944785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59494a56-cdf9-44c1-8b92-ab3f638d4b96 None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/f362b8daae13435a9a468b06c4998c67/roles/812d9626de92430d9cef17f80d5a1b4e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:34.958622 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202dc8-2be1-4de3-8f88-14d53468d82a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:34.960732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59494a56-cdf9-44c1-8b92-ab3f638d4b96 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=f362b8daae13435a9a468b06c4998c67, role_id=812d9626de92430d9cef17f80d5a1b4e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:34.962281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59494a56-cdf9-44c1-8b92-ab3f638d4b96 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:34.994400 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7c430-57ef-48f1-a249-799346a00403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:34.995018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7c430-57ef-48f1-a249-799346a00403 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:34.995290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7c430-57ef-48f1-a249-799346a00403 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:34.995552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7c430-57ef-48f1-a249-799346a00403 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.005991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7c430-57ef-48f1-a249-799346a00403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-12c7c430-57ef-48f1-a249-799346a00403 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:35.011055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:35.012188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 320/645] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:35.013353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7c430-57ef-48f1-a249-799346a00403 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.069775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 326/646] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:34 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/f362b8daae13435a9a468b06c4998c67/roles/812d9626de92430d9cef17f80d5a1b4e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:35.070880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59494a56-cdf9-44c1-8b92-ab3f638d4b96 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.138365 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7c430-57ef-48f1-a249-799346a00403 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.179248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08989949-597f-4f36-b88f-5ac904ab339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.180214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989949-597f-4f36-b88f-5ac904ab339e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.180642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989949-597f-4f36-b88f-5ac904ab339e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.181092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989949-597f-4f36-b88f-5ac904ab339e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.197534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59494a56-cdf9-44c1-8b92-ab3f638d4b96 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.199409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:35.202113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08989949-597f-4f36-b88f-5ac904ab339e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.203688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08989949-597f-4f36-b88f-5ac904ab339e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.214355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-08989949-597f-4f36-b88f-5ac904ab339e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:35.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:35.224335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:35.225458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:35.225458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:35.225458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:35.229134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 321/647] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:35.230334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08989949-597f-4f36-b88f-5ac904ab339e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.250788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5bcdc-e16b-43b5-8bf9-5d572a7ca49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.251859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5bcdc-e16b-43b5-8bf9-5d572a7ca49c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.252269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5bcdc-e16b-43b5-8bf9-5d572a7ca49c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.252672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5bcdc-e16b-43b5-8bf9-5d572a7ca49c None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.253415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5bcdc-e16b-43b5-8bf9-5d572a7ca49c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:35.253952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5bcdc-e16b-43b5-8bf9-5d572a7ca49c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.256205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5bcdc-e16b-43b5-8bf9-5d572a7ca49c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.272152 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 327/648] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:35.272861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5bcdc-e16b-43b5-8bf9-5d572a7ca49c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.361609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08989949-597f-4f36-b88f-5ac904ab339e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.397583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5bcdc-e16b-43b5-8bf9-5d572a7ca49c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.406701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82829ef-19f8-4373-904f-d3feed52814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.407515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82829ef-19f8-4373-904f-d3feed52814c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.409185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82829ef-19f8-4373-904f-d3feed52814c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.409674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82829ef-19f8-4373-904f-d3feed52814c None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.411186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82829ef-19f8-4373-904f-d3feed52814c None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:35.411915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82829ef-19f8-4373-904f-d3feed52814c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.413731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82829ef-19f8-4373-904f-d3feed52814c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.430544 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 322/649] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:35.430746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82829ef-19f8-4373-904f-d3feed52814c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.441011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ba2a0-ad4c-4c78-975f-cfb1e7c1950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.441670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ba2a0-ad4c-4c78-975f-cfb1e7c1950e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.441952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ba2a0-ad4c-4c78-975f-cfb1e7c1950e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.442227 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ba2a0-ad4c-4c78-975f-cfb1e7c1950e None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.443126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ba2a0-ad4c-4c78-975f-cfb1e7c1950e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:35.443251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ba2a0-ad4c-4c78-975f-cfb1e7c1950e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.444681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ba2a0-ad4c-4c78-975f-cfb1e7c1950e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.458728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 328/650] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:35.459745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ba2a0-ad4c-4c78-975f-cfb1e7c1950e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.493214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:35.505786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:35.564879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82829ef-19f8-4373-904f-d3feed52814c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.572151 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ba2a0-ad4c-4c78-975f-cfb1e7c1950e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.608818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1da18-d82b-45aa-bddd-29de776ef762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.609863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1da18-d82b-45aa-bddd-29de776ef762 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.610369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1da18-d82b-45aa-bddd-29de776ef762 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.610570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271457d3-b1ea-42e1-a408-2df3241b858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.611048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1da18-d82b-45aa-bddd-29de776ef762 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.611220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271457d3-b1ea-42e1-a408-2df3241b858e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.612196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271457d3-b1ea-42e1-a408-2df3241b858e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.612607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271457d3-b1ea-42e1-a408-2df3241b858e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.621209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1da18-d82b-45aa-bddd-29de776ef762 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.623666 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1da18-d82b-45aa-bddd-29de776ef762 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.623911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271457d3-b1ea-42e1-a408-2df3241b858e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.625588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271457d3-b1ea-42e1-a408-2df3241b858e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6ac1da18-d82b-45aa-bddd-29de776ef762 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:35.638086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:35.639073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:44:35.640014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-271457d3-b1ea-42e1-a408-2df3241b858e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:35.641561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:35.642448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:35.643893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:35.643893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:35.643893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:35.643893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 329/651] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:35.644127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271457d3-b1ea-42e1-a408-2df3241b858e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.651169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 323/652] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:35.652270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1da18-d82b-45aa-bddd-29de776ef762 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.738403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:35.762264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271457d3-b1ea-42e1-a408-2df3241b858e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.778676 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1da18-d82b-45aa-bddd-29de776ef762 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.795662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:35.811809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b7fbe-a74c-4aba-bc5d-28260a7b8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.812927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b7fbe-a74c-4aba-bc5d-28260a7b8736 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.813715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b7fbe-a74c-4aba-bc5d-28260a7b8736 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.814513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b7fbe-a74c-4aba-bc5d-28260a7b8736 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.818666 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c66ef-2ef8-41b1-96eb-8aebe8d51110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.819484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c66ef-2ef8-41b1-96eb-8aebe8d51110 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.819831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c66ef-2ef8-41b1-96eb-8aebe8d51110 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.820201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c66ef-2ef8-41b1-96eb-8aebe8d51110 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.820919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c66ef-2ef8-41b1-96eb-8aebe8d51110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:35.821310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c66ef-2ef8-41b1-96eb-8aebe8d51110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.822892 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c66ef-2ef8-41b1-96eb-8aebe8d51110 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.824044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b7fbe-a74c-4aba-bc5d-28260a7b8736 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.827272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b7fbe-a74c-4aba-bc5d-28260a7b8736 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:35.841770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 324/653] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:35.841770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c66ef-2ef8-41b1-96eb-8aebe8d51110 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-0f8b7fbe-a74c-4aba-bc5d-28260a7b8736 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:35.844859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:35.846338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:35.847291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 330/654] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:35.849265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b7fbe-a74c-4aba-bc5d-28260a7b8736 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:35.953436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c66ef-2ef8-41b1-96eb-8aebe8d51110 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.972802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b7fbe-a74c-4aba-bc5d-28260a7b8736 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:35.991977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf78625-2146-47ed-a074-b0c12fb2ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:35.992522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf78625-2146-47ed-a074-b0c12fb2ea07 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:35.993084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf78625-2146-47ed-a074-b0c12fb2ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:35.993200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf78625-2146-47ed-a074-b0c12fb2ea07 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:35.993978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf78625-2146-47ed-a074-b0c12fb2ea07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:35.994279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf78625-2146-47ed-a074-b0c12fb2ea07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:35.995749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf78625-2146-47ed-a074-b0c12fb2ea07 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.011510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62606bb1-92ab-4fc5-9a4b-71bf2f933511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.012557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62606bb1-92ab-4fc5-9a4b-71bf2f933511 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.013038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62606bb1-92ab-4fc5-9a4b-71bf2f933511 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.013548 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62606bb1-92ab-4fc5-9a4b-71bf2f933511 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.015787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 325/655] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:36.017340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf78625-2146-47ed-a074-b0c12fb2ea07 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.023279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62606bb1-92ab-4fc5-9a4b-71bf2f933511 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.025000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62606bb1-92ab-4fc5-9a4b-71bf2f933511 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-62606bb1-92ab-4fc5-9a4b-71bf2f933511 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:36.038502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:36.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:44:36.040394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:36.047362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 331/656] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:36.048540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62606bb1-92ab-4fc5-9a4b-71bf2f933511 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.051076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.052869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.136963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf78625-2146-47ed-a074-b0c12fb2ea07 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.155404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62606bb1-92ab-4fc5-9a4b-71bf2f933511 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.179777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848e0e-b765-4191-bd04-96b15300c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.180382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848e0e-b765-4191-bd04-96b15300c508 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.180656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848e0e-b765-4191-bd04-96b15300c508 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.180924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848e0e-b765-4191-bd04-96b15300c508 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.181680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8848e0e-b765-4191-bd04-96b15300c508 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:36.181982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8848e0e-b765-4191-bd04-96b15300c508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.183402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8848e0e-b765-4191-bd04-96b15300c508 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.194208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951bbc3-88f5-43cb-8c5b-c89b32fb6bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.194820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951bbc3-88f5-43cb-8c5b-c89b32fb6bcf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.195097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951bbc3-88f5-43cb-8c5b-c89b32fb6bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.195367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951bbc3-88f5-43cb-8c5b-c89b32fb6bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.201302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 326/657] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:36.201989 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848e0e-b765-4191-bd04-96b15300c508 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.270978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951bbc3-88f5-43cb-8c5b-c89b32fb6bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.272737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951bbc3-88f5-43cb-8c5b-c89b32fb6bcf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.275666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.296602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.306499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848e0e-b765-4191-bd04-96b15300c508 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.340840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b6a2e-7382-4bf5-814a-0a9dceacc5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.341442 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6a2e-7382-4bf5-814a-0a9dceacc5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.341752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6a2e-7382-4bf5-814a-0a9dceacc5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.342027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6a2e-7382-4bf5-814a-0a9dceacc5e7 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.342778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6a2e-7382-4bf5-814a-0a9dceacc5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:36.343115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6a2e-7382-4bf5-814a-0a9dceacc5e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.344523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6a2e-7382-4bf5-814a-0a9dceacc5e7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.367612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 327/658] 10.222.0.58 () {56 vars in 1139 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:36.368925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ea82-7dc9-45af-94ed-433352ab4940 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.369210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ea82-7dc9-45af-94ed-433352ab4940 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.369560 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ea82-7dc9-45af-94ed-433352ab4940 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.370727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 328/659] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:36.371415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846ea82-7dc9-45af-94ed-433352ab4940 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.395056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 332/660] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:36.396225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951bbc3-88f5-43cb-8c5b-c89b32fb6bcf None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.482107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846ea82-7dc9-45af-94ed-433352ab4940 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.507127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951bbc3-88f5-43cb-8c5b-c89b32fb6bcf None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.508644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.524168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaf966-41cd-403f-82de-49697b0a79fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.524708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaf966-41cd-403f-82de-49697b0a79fb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.524988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaf966-41cd-403f-82de-49697b0a79fb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.525253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaf966-41cd-403f-82de-49697b0a79fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.544445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.547052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0c47-f538-4342-83a7-19fd08c11f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.547661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0c47-f538-4342-83a7-19fd08c11f8e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.547938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0c47-f538-4342-83a7-19fd08c11f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.548505 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0c47-f538-4342-83a7-19fd08c11f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.596491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaf966-41cd-403f-82de-49697b0a79fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.598205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaf966-41cd-403f-82de-49697b0a79fb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.622258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0c47-f538-4342-83a7-19fd08c11f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.623818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0c47-f538-4342-83a7-19fd08c11f8e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.707917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 329/661] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:36.709651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535205e-eba4-43ca-876b-f2c3fafacc2b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.710160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535205e-eba4-43ca-876b-f2c3fafacc2b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.710654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535205e-eba4-43ca-876b-f2c3fafacc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.728831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e535205e-eba4-43ca-876b-f2c3fafacc2b None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:36.730079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e535205e-eba4-43ca-876b-f2c3fafacc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:36.738649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 333/662] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:36.738649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0c47-f538-4342-83a7-19fd08c11f8e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.739430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.777829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:36.801341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 330/663] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:36.802291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535205e-eba4-43ca-876b-f2c3fafacc2b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.868501 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0c47-f538-4342-83a7-19fd08c11f8e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.911300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535205e-eba4-43ca-876b-f2c3fafacc2b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:36.915166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a673b-9e51-49eb-b8aa-4ab3f8294283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.915961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a673b-9e51-49eb-b8aa-4ab3f8294283 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.916376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a673b-9e51-49eb-b8aa-4ab3f8294283 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.916786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a673b-9e51-49eb-b8aa-4ab3f8294283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.930204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a673b-9e51-49eb-b8aa-4ab3f8294283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.931983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a673b-9e51-49eb-b8aa-4ab3f8294283 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.946777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad28e-4595-467b-8f26-98a7ed2db273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:36.947412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad28e-4595-467b-8f26-98a7ed2db273 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:36.947694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad28e-4595-467b-8f26-98a7ed2db273 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:36.948024 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad28e-4595-467b-8f26-98a7ed2db273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-728a673b-9e51-49eb-b8aa-4ab3f8294283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:36.952681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:36.953777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:36.954673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:36.954673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:36.954673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:36.957037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 334/664] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:36.957995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a673b-9e51-49eb-b8aa-4ab3f8294283 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:36.964836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ad28e-4595-467b-8f26-98a7ed2db273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:36.966430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ad28e-4595-467b-8f26-98a7ed2db273 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-9e3ad28e-4595-467b-8f26-98a7ed2db273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:36.982859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:36.984039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:36.984936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:36.984936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:36.984936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:36.984936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 331/665] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:36.985305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad28e-4595-467b-8f26-98a7ed2db273 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.019154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.036546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.081459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a673b-9e51-49eb-b8aa-4ab3f8294283 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.094605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ad28e-4595-467b-8f26-98a7ed2db273 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.115966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477e123-8099-4b53-a1bd-79f7ae4a3c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.116580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477e123-8099-4b53-a1bd-79f7ae4a3c8e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.116856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477e123-8099-4b53-a1bd-79f7ae4a3c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.117120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477e123-8099-4b53-a1bd-79f7ae4a3c8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.127780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477e123-8099-4b53-a1bd-79f7ae4a3c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.127926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23a2b4-6856-4a4f-b000-31ffd5c5090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.128479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23a2b4-6856-4a4f-b000-31ffd5c5090b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.128751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23a2b4-6856-4a4f-b000-31ffd5c5090b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.129016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23a2b4-6856-4a4f-b000-31ffd5c5090b None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.129203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477e123-8099-4b53-a1bd-79f7ae4a3c8e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.129679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23a2b4-6856-4a4f-b000-31ffd5c5090b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:37.129974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23a2b4-6856-4a4f-b000-31ffd5c5090b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.131322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23a2b4-6856-4a4f-b000-31ffd5c5090b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.142112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 332/666] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1477e123-8099-4b53-a1bd-79f7ae4a3c8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:37.143476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:37.145087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:37.146455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:37.146455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:37.146455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:37.146626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23a2b4-6856-4a4f-b000-31ffd5c5090b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.146697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 335/667] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:37.146697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed70a50-2542-4632-a4c3-4dfb344ea626 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.146697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed70a50-2542-4632-a4c3-4dfb344ea626 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.146697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed70a50-2542-4632-a4c3-4dfb344ea626 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.147603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 336/668] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:37.150242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed70a50-2542-4632-a4c3-4dfb344ea626 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.239335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.248122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23a2b4-6856-4a4f-b000-31ffd5c5090b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.253546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed70a50-2542-4632-a4c3-4dfb344ea626 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.257833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.281533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe273c-673e-4203-9b0b-61a1f8dbb61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.282174 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe273c-673e-4203-9b0b-61a1f8dbb61f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.282630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe273c-673e-4203-9b0b-61a1f8dbb61f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.282902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe273c-673e-4203-9b0b-61a1f8dbb61f None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.284084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe273c-673e-4203-9b0b-61a1f8dbb61f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:37.284308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcbd18-9211-4d04-b951-69802351e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.284467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe273c-673e-4203-9b0b-61a1f8dbb61f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.284971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcbd18-9211-4d04-b951-69802351e15c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.285246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcbd18-9211-4d04-b951-69802351e15c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.285542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcbd18-9211-4d04-b951-69802351e15c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.286082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe273c-673e-4203-9b0b-61a1f8dbb61f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.295650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcbd18-9211-4d04-b951-69802351e15c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:37.297069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 333/669] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.297881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe273c-673e-4203-9b0b-61a1f8dbb61f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-a3fcbd18-9211-4d04-b951-69802351e15c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:37.301063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:37.302217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:37.303120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 337/670] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:37.303814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcbd18-9211-4d04-b951-69802351e15c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.401191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe273c-673e-4203-9b0b-61a1f8dbb61f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.405441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcbd18-9211-4d04-b951-69802351e15c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.435519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c6a09-be3e-41a8-b47b-660633afcb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.436144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c6a09-be3e-41a8-b47b-660633afcb95 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.436421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c6a09-be3e-41a8-b47b-660633afcb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.436691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c6a09-be3e-41a8-b47b-660633afcb95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.438733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac34347-5bbd-41ef-a3c2-e4fed29ce8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.439371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34347-5bbd-41ef-a3c2-e4fed29ce8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.439660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34347-5bbd-41ef-a3c2-e4fed29ce8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.439931 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34347-5bbd-41ef-a3c2-e4fed29ce8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.440559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac34347-5bbd-41ef-a3c2-e4fed29ce8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:37.440854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac34347-5bbd-41ef-a3c2-e4fed29ce8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.442235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac34347-5bbd-41ef-a3c2-e4fed29ce8b4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.443384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c6a09-be3e-41a8-b47b-660633afcb95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.444810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c6a09-be3e-41a8-b47b-660633afcb95 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.453746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 338/671] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.455528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaf5d4-8521-4cdb-b288-a2f81e712802 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.455793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaf5d4-8521-4cdb-b288-a2f81e712802 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.456071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaf5d4-8521-4cdb-b288-a2f81e712802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-242c6a09-be3e-41a8-b47b-660633afcb95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:37.456401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:37.457251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:37.458254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:37.458254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:37.458254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:37.458254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:37.458254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:37.458254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:37.458254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:37.458254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:37.462162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 334/672] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:37.463033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c6a09-be3e-41a8-b47b-660633afcb95 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.474838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-dcdaf5d4-8521-4cdb-b288-a2f81e712802 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:37.476018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-dcdaf5d4-8521-4cdb-b288-a2f81e712802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:37.476151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.495811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.542952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 339/673] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:37.543772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdaf5d4-8521-4cdb-b288-a2f81e712802 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.563079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c6a09-be3e-41a8-b47b-660633afcb95 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.600720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d30b7-56d8-4da9-bbbe-ced0a8a2b38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.601711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d30b7-56d8-4da9-bbbe-ced0a8a2b38e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.602190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d30b7-56d8-4da9-bbbe-ced0a8a2b38e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.602634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d30b7-56d8-4da9-bbbe-ced0a8a2b38e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.609664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d30b7-56d8-4da9-bbbe-ced0a8a2b38e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.611388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d30b7-56d8-4da9-bbbe-ced0a8a2b38e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-b15d30b7-56d8-4da9-bbbe-ced0a8a2b38e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:37.623267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:37.624349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:37.625484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:37.625484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:37.625484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:37.625484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:37.625484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:37.625484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:37.625484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:37.625484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:37.626313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 335/674] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:37.627255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d30b7-56d8-4da9-bbbe-ced0a8a2b38e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.653634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdaf5d4-8521-4cdb-b288-a2f81e712802 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.692005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02a349-ef5e-4189-b54f-1075dd0cade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.692607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02a349-ef5e-4189-b54f-1075dd0cade3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.692890 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02a349-ef5e-4189-b54f-1075dd0cade3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.693174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02a349-ef5e-4189-b54f-1075dd0cade3 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.693864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02a349-ef5e-4189-b54f-1075dd0cade3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:37.694166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02a349-ef5e-4189-b54f-1075dd0cade3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.695539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02a349-ef5e-4189-b54f-1075dd0cade3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.703834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 340/675] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.704574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02a349-ef5e-4189-b54f-1075dd0cade3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.709647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.724030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.743338 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d30b7-56d8-4da9-bbbe-ced0a8a2b38e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.777530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58189da1-7431-4284-9839-5fedf5cf4735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.778157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189da1-7431-4284-9839-5fedf5cf4735 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.778429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189da1-7431-4284-9839-5fedf5cf4735 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.778696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189da1-7431-4284-9839-5fedf5cf4735 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.785285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58189da1-7431-4284-9839-5fedf5cf4735 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.787003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58189da1-7431-4284-9839-5fedf5cf4735 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-58189da1-7431-4284-9839-5fedf5cf4735 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:37.797888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:37.799392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:37.800317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:37.800317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:37.800317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:37.800317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:37.800317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:37.800317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:37.800317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:37.800317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:37.800317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 336/676] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:37.800817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58189da1-7431-4284-9839-5fedf5cf4735 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.816563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02a349-ef5e-4189-b54f-1075dd0cade3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.850495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd919a-724b-4e82-bfa3-71912ecbb59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.851094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd919a-724b-4e82-bfa3-71912ecbb59d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.851367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd919a-724b-4e82-bfa3-71912ecbb59d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.851634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd919a-724b-4e82-bfa3-71912ecbb59d None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.852314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd919a-724b-4e82-bfa3-71912ecbb59d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:37.852631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd919a-724b-4e82-bfa3-71912ecbb59d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.854063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd919a-724b-4e82-bfa3-71912ecbb59d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.866082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 341/677] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.866673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd919a-724b-4e82-bfa3-71912ecbb59d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.901891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58189da1-7431-4284-9839-5fedf5cf4735 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.929915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.935699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a00f-57a0-48f6-b0c0-9e1ab1a154c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:37.936291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a00f-57a0-48f6-b0c0-9e1ab1a154c7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:37.936564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a00f-57a0-48f6-b0c0-9e1ab1a154c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:37.936831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a00f-57a0-48f6-b0c0-9e1ab1a154c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:37.937536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a00f-57a0-48f6-b0c0-9e1ab1a154c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:37.937837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a00f-57a0-48f6-b0c0-9e1ab1a154c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:37.939243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a00f-57a0-48f6-b0c0-9e1ab1a154c7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:37.943334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.950877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 337/678] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:37.951760 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a00f-57a0-48f6-b0c0-9e1ab1a154c7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:37.965308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd919a-724b-4e82-bfa3-71912ecbb59d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:37.999597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4b2f-c90c-4655-812c-140edc3763d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.000219 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4b2f-c90c-4655-812c-140edc3763d8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.000493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4b2f-c90c-4655-812c-140edc3763d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.000766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4b2f-c90c-4655-812c-140edc3763d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.011778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d4b2f-c90c-4655-812c-140edc3763d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.013206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d4b2f-c90c-4655-812c-140edc3763d8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-a55d4b2f-c90c-4655-812c-140edc3763d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:38.026856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:38.027907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:38.028793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:38.028793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:38.028793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:38.032542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 342/679] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:38.033915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4b2f-c90c-4655-812c-140edc3763d8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.052063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a00f-57a0-48f6-b0c0-9e1ab1a154c7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.085872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48f8f-0708-4181-918d-e35ecc05d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.086407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48f8f-0708-4181-918d-e35ecc05d20c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.086686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48f8f-0708-4181-918d-e35ecc05d20c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.086957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48f8f-0708-4181-918d-e35ecc05d20c None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.087643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48f8f-0708-4181-918d-e35ecc05d20c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:38.087944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48f8f-0708-4181-918d-e35ecc05d20c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.089433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48f8f-0708-4181-918d-e35ecc05d20c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.101430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 338/680] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:38.102247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48f8f-0708-4181-918d-e35ecc05d20c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.131847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4b2f-c90c-4655-812c-140edc3763d8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.151743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.161193 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.166759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d1ed1-728d-4e93-98b9-2738df71da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.167395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1ed1-728d-4e93-98b9-2738df71da6f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.167672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1ed1-728d-4e93-98b9-2738df71da6f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.167940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1ed1-728d-4e93-98b9-2738df71da6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.178724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d1ed1-728d-4e93-98b9-2738df71da6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-de9d1ed1-728d-4e93-98b9-2738df71da6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:38.183461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:38.184396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 343/681] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:38.185322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d1ed1-728d-4e93-98b9-2738df71da6f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.206581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48f8f-0708-4181-918d-e35ecc05d20c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.240418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c8a5b-4a2c-4e42-9542-710aa60a59a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.241022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c8a5b-4a2c-4e42-9542-710aa60a59a5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.241297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c8a5b-4a2c-4e42-9542-710aa60a59a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.241603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c8a5b-4a2c-4e42-9542-710aa60a59a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.242320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c8a5b-4a2c-4e42-9542-710aa60a59a5 None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=79bb81300cff46b7ba1680eedf2762cf) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:38.242623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c8a5b-4a2c-4e42-9542-710aa60a59a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.244032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c8a5b-4a2c-4e42-9542-710aa60a59a5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.249714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 339/682] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/role_assignments?user.id=79bb81300cff46b7ba1680eedf2762cf&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:38.250501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c8a5b-4a2c-4e42-9542-710aa60a59a5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.294716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d1ed1-728d-4e93-98b9-2738df71da6f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.335854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e33fb-a8c5-4703-bec2-c098f8d145bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.336888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e33fb-a8c5-4703-bec2-c098f8d145bd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.337120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e33fb-a8c5-4703-bec2-c098f8d145bd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.337399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e33fb-a8c5-4703-bec2-c098f8d145bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.338176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e33fb-a8c5-4703-bec2-c098f8d145bd None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=23734a2b701a46c3a25ae547aff98026) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:38.338484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e33fb-a8c5-4703-bec2-c098f8d145bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.339944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e33fb-a8c5-4703-bec2-c098f8d145bd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.347284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 344/683] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/role_assignments?user.id=23734a2b701a46c3a25ae547aff98026&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:38.356986 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e33fb-a8c5-4703-bec2-c098f8d145bd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.413758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c8a5b-4a2c-4e42-9542-710aa60a59a5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.422599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.436458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.469347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff448-d467-4a81-9208-4de035fec542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.469992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff448-d467-4a81-9208-4de035fec542 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.470273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff448-d467-4a81-9208-4de035fec542 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.471437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff448-d467-4a81-9208-4de035fec542 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.472259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bff448-d467-4a81-9208-4de035fec542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:38.472759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bff448-d467-4a81-9208-4de035fec542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.474330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bff448-d467-4a81-9208-4de035fec542 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.484192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e33fb-a8c5-4703-bec2-c098f8d145bd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.489694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 340/684] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:38.490410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff448-d467-4a81-9208-4de035fec542 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.528560 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273af7c-f322-4a53-912f-b299742ac01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.529837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273af7c-f322-4a53-912f-b299742ac01d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.530130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273af7c-f322-4a53-912f-b299742ac01d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.530398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273af7c-f322-4a53-912f-b299742ac01d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.531189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273af7c-f322-4a53-912f-b299742ac01d None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=321d07f93b7540128dc5415d8b3252c2) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:38.531495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273af7c-f322-4a53-912f-b299742ac01d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.533156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273af7c-f322-4a53-912f-b299742ac01d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.542575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 345/685] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/role_assignments?user.id=321d07f93b7540128dc5415d8b3252c2&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:38.544097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273af7c-f322-4a53-912f-b299742ac01d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.626548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff448-d467-4a81-9208-4de035fec542 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.668912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd00f77-ff02-4feb-a4d3-b1dda952dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.669580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd00f77-ff02-4feb-a4d3-b1dda952dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.669857 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd00f77-ff02-4feb-a4d3-b1dda952dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.670127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd00f77-ff02-4feb-a4d3-b1dda952dfd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.670810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd00f77-ff02-4feb-a4d3-b1dda952dfd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:38.671108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd00f77-ff02-4feb-a4d3-b1dda952dfd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.672506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd00f77-ff02-4feb-a4d3-b1dda952dfd7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.682197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 341/686] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:38.687897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd00f77-ff02-4feb-a4d3-b1dda952dfd7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.697009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273af7c-f322-4a53-912f-b299742ac01d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.721311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.735775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:38.743074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87046d7d-13c4-4cfa-b326-45ff984a7049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.743724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87046d7d-13c4-4cfa-b326-45ff984a7049 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.744004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87046d7d-13c4-4cfa-b326-45ff984a7049 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.744275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87046d7d-13c4-4cfa-b326-45ff984a7049 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.753081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87046d7d-13c4-4cfa-b326-45ff984a7049 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.754588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87046d7d-13c4-4cfa-b326-45ff984a7049 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-87046d7d-13c4-4cfa-b326-45ff984a7049 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:38.767168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:38.768757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:38.770559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 346/687] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:38.774291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87046d7d-13c4-4cfa-b326-45ff984a7049 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.826403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd00f77-ff02-4feb-a4d3-b1dda952dfd7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.874977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3a5e3-d8e2-45b3-8720-96a1d609a012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.875348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3a5e3-d8e2-45b3-8720-96a1d609a012 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.875601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3a5e3-d8e2-45b3-8720-96a1d609a012 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.875873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3a5e3-d8e2-45b3-8720-96a1d609a012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.890621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3a5e3-d8e2-45b3-8720-96a1d609a012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.892015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3a5e3-d8e2-45b3-8720-96a1d609a012 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:38.911880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87046d7d-13c4-4cfa-b326-45ff984a7049 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-dbb3a5e3-d8e2-45b3-8720-96a1d609a012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:38.914392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:38.915355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:38.916267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:38.916267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:38.916267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:38.916267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 342/688] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:38.925035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3a5e3-d8e2-45b3-8720-96a1d609a012 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:38.985157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354fb8-c810-448f-9fbd-fff4f28dec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:38.985797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354fb8-c810-448f-9fbd-fff4f28dec87 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:38.986077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354fb8-c810-448f-9fbd-fff4f28dec87 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:38.987195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354fb8-c810-448f-9fbd-fff4f28dec87 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:38.987983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6354fb8-c810-448f-9fbd-fff4f28dec87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:38.988265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6354fb8-c810-448f-9fbd-fff4f28dec87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:38.989725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6354fb8-c810-448f-9fbd-fff4f28dec87 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.010997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 347/689] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:39.016668 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354fb8-c810-448f-9fbd-fff4f28dec87 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:39.058868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:39.133833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:39.135166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354fb8-c810-448f-9fbd-fff4f28dec87 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:39.167744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3a5e3-d8e2-45b3-8720-96a1d609a012 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:39.174485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575b69-2669-4ca5-83ea-1edfe01d80f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:39.175921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575b69-2669-4ca5-83ea-1edfe01d80f5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.176197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575b69-2669-4ca5-83ea-1edfe01d80f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.176482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575b69-2669-4ca5-83ea-1edfe01d80f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.241498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b038986-3553-4a95-baa4-4ecfa989fed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:39.242129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b038986-3553-4a95-baa4-4ecfa989fed9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.242408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b038986-3553-4a95-baa4-4ecfa989fed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.242679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b038986-3553-4a95-baa4-4ecfa989fed9 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.243328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b038986-3553-4a95-baa4-4ecfa989fed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:39.243627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b038986-3553-4a95-baa4-4ecfa989fed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:39.244990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b038986-3553-4a95-baa4-4ecfa989fed9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.263961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 343/690] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:39.271790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b038986-3553-4a95-baa4-4ecfa989fed9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:39.314102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4575b69-2669-4ca5-83ea-1edfe01d80f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:39.322237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4575b69-2669-4ca5-83ea-1edfe01d80f5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.405385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b038986-3553-4a95-baa4-4ecfa989fed9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:39.441910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:39.481879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 348/691] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:39.483473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575b69-2669-4ca5-83ea-1edfe01d80f5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:39.554814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3bbb9-e72a-4ba5-8a79-5aa0cf9eedac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:39.555459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3bbb9-e72a-4ba5-8a79-5aa0cf9eedac None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.555752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3bbb9-e72a-4ba5-8a79-5aa0cf9eedac None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.556005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3bbb9-e72a-4ba5-8a79-5aa0cf9eedac None admin] PATH_INFO: `/v3/users/swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.564137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3bbb9-e72a-4ba5-8a79-5aa0cf9eedac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:39.566716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3bbb9-e72a-4ba5-8a79-5aa0cf9eedac None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-fee3bbb9-e72a-4ba5-8a79-5aa0cf9eedac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:39.578276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:39.579256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:39.580947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 344/692] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:39.590443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3bbb9-e72a-4ba5-8a79-5aa0cf9eedac None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:39.607159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575b69-2669-4ca5-83ea-1edfe01d80f5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:39.613778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:39.652981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb3721-3dbf-4f86-8925-76fdaf51b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:39.653829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb3721-3dbf-4f86-8925-76fdaf51b78b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.654186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb3721-3dbf-4f86-8925-76fdaf51b78b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.654537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb3721-3dbf-4f86-8925-76fdaf51b78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.665827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:39.670199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb3721-3dbf-4f86-8925-76fdaf51b78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:39.672000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb3721-3dbf-4f86-8925-76fdaf51b78b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-e1bb3721-3dbf-4f86-8925-76fdaf51b78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:39.688547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:39.690396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:39.691443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:39.691443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:39.691443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:39.693619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 349/693] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:39.699065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb3721-3dbf-4f86-8925-76fdaf51b78b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:39.809400 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3bbb9-e72a-4ba5-8a79-5aa0cf9eedac None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:39.864014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb3721-3dbf-4f86-8925-76fdaf51b78b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:39.874710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaacf1-bbd7-4298-a293-c2bb16c87ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:39.875648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaacf1-bbd7-4298-a293-c2bb16c87ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.876225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaacf1-bbd7-4298-a293-c2bb16c87ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.876744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaacf1-bbd7-4298-a293-c2bb16c87ba6 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.878884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaacf1-bbd7-4298-a293-c2bb16c87ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:39.879483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaacf1-bbd7-4298-a293-c2bb16c87ba6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:39.881184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaacf1-bbd7-4298-a293-c2bb16c87ba6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.901067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767a8b3-6fbf-4cfd-8363-f4a963cf540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:39.901702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767a8b3-6fbf-4cfd-8363-f4a963cf540f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:39.901985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767a8b3-6fbf-4cfd-8363-f4a963cf540f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:39.902258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767a8b3-6fbf-4cfd-8363-f4a963cf540f None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:39.902905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767a8b3-6fbf-4cfd-8363-f4a963cf540f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:39.903205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767a8b3-6fbf-4cfd-8363-f4a963cf540f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:39.904578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767a8b3-6fbf-4cfd-8363-f4a963cf540f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:39.917454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 350/694] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:39.919756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 345/695] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 07:44:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:39.922423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767a8b3-6fbf-4cfd-8363-f4a963cf540f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:39.926365 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaacf1-bbd7-4298-a293-c2bb16c87ba6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.014463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.036039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.060359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaacf1-bbd7-4298-a293-c2bb16c87ba6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.092980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767a8b3-6fbf-4cfd-8363-f4a963cf540f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.130370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ab112-cad8-4fa7-8298-f416fc842796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.131006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ab112-cad8-4fa7-8298-f416fc842796 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.131301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ab112-cad8-4fa7-8298-f416fc842796 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.131550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ab112-cad8-4fa7-8298-f416fc842796 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.144178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ab112-cad8-4fa7-8298-f416fc842796 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:40.146599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ab112-cad8-4fa7-8298-f416fc842796 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:40.150539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d46fc-b6f9-4373-b2ed-a26829aae6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.151157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d46fc-b6f9-4373-b2ed-a26829aae6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.151433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d46fc-b6f9-4373-b2ed-a26829aae6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.151704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d46fc-b6f9-4373-b2ed-a26829aae6f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-af6ab112-cad8-4fa7-8298-f416fc842796 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:40.172300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:40.173256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:40.174799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:40.174799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:40.174799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:40.174799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:40.174799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:40.174799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:40.174799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:40.174799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:40.174799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 351/696] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:40.179880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ab112-cad8-4fa7-8298-f416fc842796 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.280634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d46fc-b6f9-4373-b2ed-a26829aae6f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:40.282114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d46fc-b6f9-4373-b2ed-a26829aae6f0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:40.405009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.443789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ab112-cad8-4fa7-8298-f416fc842796 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.453156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.461497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 346/697] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:40.469389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d46fc-b6f9-4373-b2ed-a26829aae6f0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.482670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309f347-850e-49b3-b4f8-c7c6311d8cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.483285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309f347-850e-49b3-b4f8-c7c6311d8cff None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.483562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309f347-850e-49b3-b4f8-c7c6311d8cff None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.483832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309f347-850e-49b3-b4f8-c7c6311d8cff None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.484521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309f347-850e-49b3-b4f8-c7c6311d8cff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:40.484818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309f347-850e-49b3-b4f8-c7c6311d8cff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:40.486839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309f347-850e-49b3-b4f8-c7c6311d8cff None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:40.499373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 352/698] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:40.505722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309f347-850e-49b3-b4f8-c7c6311d8cff None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:40.608829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309f347-850e-49b3-b4f8-c7c6311d8cff None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.647135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a961d2-1a1b-46fe-9b93-b63e62028ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.647741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a961d2-1a1b-46fe-9b93-b63e62028ecb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.648021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a961d2-1a1b-46fe-9b93-b63e62028ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.648290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a961d2-1a1b-46fe-9b93-b63e62028ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.649015 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a961d2-1a1b-46fe-9b93-b63e62028ecb None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=6ef753445d864a0ab30ec970446b29cd) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:40.649317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a961d2-1a1b-46fe-9b93-b63e62028ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:40.651216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a961d2-1a1b-46fe-9b93-b63e62028ecb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:40.656855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 353/699] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/role_assignments?user.id=6ef753445d864a0ab30ec970446b29cd&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:40.681061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b4870-d1a4-496f-9cd6-67b55c8178d6 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.681396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b4870-d1a4-496f-9cd6-67b55c8178d6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.681640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b4870-d1a4-496f-9cd6-67b55c8178d6 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.684298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 354/700] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:40.699854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bcfa1-855f-46f8-b8e1-ec0b45d25565 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.700217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bcfa1-855f-46f8-b8e1-ec0b45d25565 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.700397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bcfa1-855f-46f8-b8e1-ec0b45d25565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.721104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ef1bcfa1-855f-46f8-b8e1-ec0b45d25565 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:40.722498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ef1bcfa1-855f-46f8-b8e1-ec0b45d25565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:40.746037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d46fc-b6f9-4373-b2ed-a26829aae6f0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:40.756172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.805168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 355/701] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:40.834348 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d4d9-cf40-4c40-b564-67eb84b852e5 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.834633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d4d9-cf40-4c40-b564-67eb84b852e5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.834919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d4d9-cf40-4c40-b564-67eb84b852e5 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.836639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 356/702] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:40.842021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96accbcd-ac1f-4160-953f-8b6a91d059aa None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.842227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daefaef-fa8d-42b2-831d-0abc53bbb4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:40.842335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96accbcd-ac1f-4160-953f-8b6a91d059aa None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.842584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96accbcd-ac1f-4160-953f-8b6a91d059aa None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.842865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daefaef-fa8d-42b2-831d-0abc53bbb4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.843146 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daefaef-fa8d-42b2-831d-0abc53bbb4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.843417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daefaef-fa8d-42b2-831d-0abc53bbb4a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.844166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 357/703] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:40.845280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cc951-356f-4883-8854-36c1aee4ce99 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.845815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cc951-356f-4883-8854-36c1aee4ce99 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.846243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cc951-356f-4883-8854-36c1aee4ce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.859332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daefaef-fa8d-42b2-831d-0abc53bbb4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:40.860721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daefaef-fa8d-42b2-831d-0abc53bbb4a1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:40.865088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-838cc951-356f-4883-8854-36c1aee4ce99 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:40.866434 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-838cc951-356f-4883-8854-36c1aee4ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-2daefaef-fa8d-42b2-831d-0abc53bbb4a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:40.882309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:40.883429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:40.884643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:40.884643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:40.884643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:40.884643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 347/704] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:40.885889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938f81d-247d-494d-908e-1eaaa1349101 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:40.886167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938f81d-247d-494d-908e-1eaaa1349101 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:40.886738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938f81d-247d-494d-908e-1eaaa1349101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:40.906197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d938f81d-247d-494d-908e-1eaaa1349101 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:40.907436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d938f81d-247d-494d-908e-1eaaa1349101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:40.921100 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.949493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 358/705] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:40.949493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cc951-356f-4883-8854-36c1aee4ce99 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.031674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 348/706] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:41.055354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.068422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cc951-356f-4883-8854-36c1aee4ce99 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.107664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2b1c8-b019-4f53-b1d1-7e81f8a22223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.108271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2b1c8-b019-4f53-b1d1-7e81f8a22223 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.108546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2b1c8-b019-4f53-b1d1-7e81f8a22223 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.108813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2b1c8-b019-4f53-b1d1-7e81f8a22223 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.109599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2b1c8-b019-4f53-b1d1-7e81f8a22223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:41.109846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2b1c8-b019-4f53-b1d1-7e81f8a22223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.111832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2b1c8-b019-4f53-b1d1-7e81f8a22223 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.123438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 359/707] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:41.128624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938f81d-247d-494d-908e-1eaaa1349101 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.134611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2b1c8-b019-4f53-b1d1-7e81f8a22223 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.292025 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938f81d-247d-494d-908e-1eaaa1349101 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.294852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2b1c8-b019-4f53-b1d1-7e81f8a22223 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.331640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7137ca5-c1d3-4790-906f-a6451db0f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.332736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137ca5-c1d3-4790-906f-a6451db0f709 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.333215 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137ca5-c1d3-4790-906f-a6451db0f709 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.333723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137ca5-c1d3-4790-906f-a6451db0f709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.337576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8cc46-642f-4a1b-8f84-82e340712469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.338280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8cc46-642f-4a1b-8f84-82e340712469 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.338672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8cc46-642f-4a1b-8f84-82e340712469 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.339011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8cc46-642f-4a1b-8f84-82e340712469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.341821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7137ca5-c1d3-4790-906f-a6451db0f709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.343462 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7137ca5-c1d3-4790-906f-a6451db0f709 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.351224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8cc46-642f-4a1b-8f84-82e340712469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.358115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8cc46-642f-4a1b-8f84-82e340712469 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-b7137ca5-c1d3-4790-906f-a6451db0f709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:41.358236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:41.359061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:41.360003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:41.360003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:41.360003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:41.360003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:41.360003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:41.360003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:41.360003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:41.360003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:41.360793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 349/708] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:41.363109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7137ca5-c1d3-4790-906f-a6451db0f709 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.375304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1cf8cc46-642f-4a1b-8f84-82e340712469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:41.381036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:41.382131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:41.383108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:41.383108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:41.383108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:41.387926 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 360/709] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:41.388898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8cc46-642f-4a1b-8f84-82e340712469 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.394510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.488592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7137ca5-c1d3-4790-906f-a6451db0f709 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.503767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8cc46-642f-4a1b-8f84-82e340712469 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.524113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15057e36-c47d-4ddb-8bb1-242835680600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.524740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15057e36-c47d-4ddb-8bb1-242835680600 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.525019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15057e36-c47d-4ddb-8bb1-242835680600 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.525290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15057e36-c47d-4ddb-8bb1-242835680600 None admin] PATH_INFO: `/v3/services/network` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.525901 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15057e36-c47d-4ddb-8bb1-242835680600 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.527257 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15057e36-c47d-4ddb-8bb1-242835680600 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-15057e36-c47d-4ddb-8bb1-242835680600 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:41.537921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:41.539233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:41.540283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 350/710] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:41.541305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15057e36-c47d-4ddb-8bb1-242835680600 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.546241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b0418-ed81-4d21-8bb8-34ec097de9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.546851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b0418-ed81-4d21-8bb8-34ec097de9dc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.547122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b0418-ed81-4d21-8bb8-34ec097de9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.547384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b0418-ed81-4d21-8bb8-34ec097de9dc None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.548075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b0418-ed81-4d21-8bb8-34ec097de9dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:41.548373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b0418-ed81-4d21-8bb8-34ec097de9dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.551030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b0418-ed81-4d21-8bb8-34ec097de9dc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.566159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 361/711] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:41.567028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b0418-ed81-4d21-8bb8-34ec097de9dc None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.624885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.630821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.662993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15057e36-c47d-4ddb-8bb1-242835680600 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.672306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b0418-ed81-4d21-8bb8-34ec097de9dc None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.701955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd6715-64cc-415e-9d80-b08feef40e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.702561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd6715-64cc-415e-9d80-b08feef40e8b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.702840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd6715-64cc-415e-9d80-b08feef40e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.703127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd6715-64cc-415e-9d80-b08feef40e8b None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.703745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd6715-64cc-415e-9d80-b08feef40e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:41.704046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd6715-64cc-415e-9d80-b08feef40e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.706370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd6715-64cc-415e-9d80-b08feef40e8b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.710520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5ac53-72d7-49d9-b493-eb8bdafb8dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.711149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ac53-72d7-49d9-b493-eb8bdafb8dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.711420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ac53-72d7-49d9-b493-eb8bdafb8dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.711687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ac53-72d7-49d9-b493-eb8bdafb8dd3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.712259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5ac53-72d7-49d9-b493-eb8bdafb8dd3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.713618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5ac53-72d7-49d9-b493-eb8bdafb8dd3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.722811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 351/712] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:41.722811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd6715-64cc-415e-9d80-b08feef40e8b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d7b5ac53-72d7-49d9-b493-eb8bdafb8dd3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:41.729358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:41.730423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:41.731314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 362/713] 10.222.0.58 () {56 vars in 1129 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:41.732105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5ac53-72d7-49d9-b493-eb8bdafb8dd3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.832698 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd6715-64cc-415e-9d80-b08feef40e8b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.842708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5ac53-72d7-49d9-b493-eb8bdafb8dd3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:41.869344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.870476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:41.876415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dcb60-22a6-4bda-9c70-c6005b0c8e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.877717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dcb60-22a6-4bda-9c70-c6005b0c8e43 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.877998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dcb60-22a6-4bda-9c70-c6005b0c8e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.881773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2974d92-4f73-4654-b9f5-bb4d70c22ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:41.881884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dcb60-22a6-4bda-9c70-c6005b0c8e43 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.881968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974d92-4f73-4654-b9f5-bb4d70c22ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:41.882066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dcb60-22a6-4bda-9c70-c6005b0c8e43 None admin] RBAC: Adding query filter params (name=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:41.882199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974d92-4f73-4654-b9f5-bb4d70c22ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:41.882199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2974d92-4f73-4654-b9f5-bb4d70c22ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:41.882450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dcb60-22a6-4bda-9c70-c6005b0c8e43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.882584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2974d92-4f73-4654-b9f5-bb4d70c22ca0 None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=f362b8daae13435a9a468b06c4998c67) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:41.882584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2974d92-4f73-4654-b9f5-bb4d70c22ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:41.882861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dcb60-22a6-4bda-9c70-c6005b0c8e43 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.883007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2974d92-4f73-4654-b9f5-bb4d70c22ca0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:41.893993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 363/714] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/role_assignments?user.id=f362b8daae13435a9a468b06c4998c67&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:41.893993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2974d92-4f73-4654-b9f5-bb4d70c22ca0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:41.894441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 352/715] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:41.894441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dcb60-22a6-4bda-9c70-c6005b0c8e43 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:42.017810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dcb60-22a6-4bda-9c70-c6005b0c8e43 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:42.020457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2974d92-4f73-4654-b9f5-bb4d70c22ca0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:42.055406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b556fc-6f81-4f06-974e-b13131cb4df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:42.056022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b556fc-6f81-4f06-974e-b13131cb4df3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.056296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b556fc-6f81-4f06-974e-b13131cb4df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.056565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b556fc-6f81-4f06-974e-b13131cb4df3 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.057191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b556fc-6f81-4f06-974e-b13131cb4df3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:42.057571 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b556fc-6f81-4f06-974e-b13131cb4df3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:42.058864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b556fc-6f81-4f06-974e-b13131cb4df3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:42.059054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4497-4c6a-40b9-965d-e0a10c1c1c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:42.059662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4497-4c6a-40b9-965d-e0a10c1c1c87 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.059938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4497-4c6a-40b9-965d-e0a10c1c1c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.060212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4497-4c6a-40b9-965d-e0a10c1c1c87 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.060852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4497-4c6a-40b9-965d-e0a10c1c1c87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:42.062319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4497-4c6a-40b9-965d-e0a10c1c1c87 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:42.063630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 353/716] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 07:44:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:42.065003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b556fc-6f81-4f06-974e-b13131cb4df3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:42.132014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:42.163562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 364/717] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:44:41 2022] POST /identity/v3/users => generated 254 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:42.164754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4497-4c6a-40b9-965d-e0a10c1c1c87 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:42.178236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b556fc-6f81-4f06-974e-b13131cb4df3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:42.222890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f5f2e-360d-4c9b-a8e7-e66885546d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:42.223502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f5f2e-360d-4c9b-a8e7-e66885546d43 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.223775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f5f2e-360d-4c9b-a8e7-e66885546d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.224092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f5f2e-360d-4c9b-a8e7-e66885546d43 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.224727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f5f2e-360d-4c9b-a8e7-e66885546d43 None admin] RBAC: Adding query filter params (type=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:42.225022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f5f2e-360d-4c9b-a8e7-e66885546d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:42.226430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f5f2e-360d-4c9b-a8e7-e66885546d43 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:42.232764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 354/718] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:44:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:42.301898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:42.327314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4497-4c6a-40b9-965d-e0a10c1c1c87 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:42.385214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabf1da-7d7a-4ab2-b16a-a04a49c71ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:42.385799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabf1da-7d7a-4ab2-b16a-a04a49c71ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.386076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabf1da-7d7a-4ab2-b16a-a04a49c71ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.386345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabf1da-7d7a-4ab2-b16a-a04a49c71ee6 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.386996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabf1da-7d7a-4ab2-b16a-a04a49c71ee6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:42.387297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabf1da-7d7a-4ab2-b16a-a04a49c71ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:42.388801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabf1da-7d7a-4ab2-b16a-a04a49c71ee6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:42.398878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 365/719] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 07:44:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:42.768834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e71718-3d15-4c9f-bb7a-66401e99c412 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.769360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e71718-3d15-4c9f-bb7a-66401e99c412 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.769360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e71718-3d15-4c9f-bb7a-66401e99c412 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.770889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 355/720] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:42.776183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38490-cc33-4eda-8644-820bb734cd82 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:42.776460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38490-cc33-4eda-8644-820bb734cd82 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:42.776729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf38490-cc33-4eda-8644-820bb734cd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:42.795473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-bbf38490-cc33-4eda-8644-820bb734cd82 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:42.796639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bbf38490-cc33-4eda-8644-820bb734cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:42.867869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 366/721] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:43.137336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e71718-3d15-4c9f-bb7a-66401e99c412 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.283284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e71718-3d15-4c9f-bb7a-66401e99c412 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.312322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:43.324850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943f832-ae6c-4254-b80e-165900c7007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.325504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943f832-ae6c-4254-b80e-165900c7007b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.325787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943f832-ae6c-4254-b80e-165900c7007b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.337659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943f832-ae6c-4254-b80e-165900c7007b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.337659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943f832-ae6c-4254-b80e-165900c7007b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d943f832-ae6c-4254-b80e-165900c7007b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:43.342179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:43.343135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:43.344002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 356/722] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:43.350034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38490-cc33-4eda-8644-820bb734cd82 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.415018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:43.482132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf38490-cc33-4eda-8644-820bb734cd82 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.519605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d810e76-d392-4f9c-bbaa-1fde49ac6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.520214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d810e76-d392-4f9c-bbaa-1fde49ac6989 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.520490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d810e76-d392-4f9c-bbaa-1fde49ac6989 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.520761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d810e76-d392-4f9c-bbaa-1fde49ac6989 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.521430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d810e76-d392-4f9c-bbaa-1fde49ac6989 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:43.521759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d810e76-d392-4f9c-bbaa-1fde49ac6989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:43.523117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d810e76-d392-4f9c-bbaa-1fde49ac6989 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:43.531634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 367/723] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:43.538116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943f832-ae6c-4254-b80e-165900c7007b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.696405 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943f832-ae6c-4254-b80e-165900c7007b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.738745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f828949-caeb-4af9-8a2b-0d0b350cadcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.739384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f828949-caeb-4af9-8a2b-0d0b350cadcc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.739660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f828949-caeb-4af9-8a2b-0d0b350cadcc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.739928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f828949-caeb-4af9-8a2b-0d0b350cadcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.757729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f828949-caeb-4af9-8a2b-0d0b350cadcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:43.759185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f828949-caeb-4af9-8a2b-0d0b350cadcc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6f828949-caeb-4af9-8a2b-0d0b350cadcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:43.775256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:43.776761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:43.777750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:43.777750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:43.777750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:43.777750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 357/724] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:43.782731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d810e76-d392-4f9c-bbaa-1fde49ac6989 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:43.927034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d810e76-d392-4f9c-bbaa-1fde49ac6989 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:43.929453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:43.966762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606a3c-7501-4cbd-a1de-a5f2debbe62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:43.967290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606a3c-7501-4cbd-a1de-a5f2debbe62b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:43.967566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606a3c-7501-4cbd-a1de-a5f2debbe62b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:43.967890 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606a3c-7501-4cbd-a1de-a5f2debbe62b None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:43.968535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28606a3c-7501-4cbd-a1de-a5f2debbe62b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:43.968836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28606a3c-7501-4cbd-a1de-a5f2debbe62b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:43.970219 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28606a3c-7501-4cbd-a1de-a5f2debbe62b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:43.987869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 368/725] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:43.993311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f828949-caeb-4af9-8a2b-0d0b350cadcc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.033294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:44.101484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f828949-caeb-4af9-8a2b-0d0b350cadcc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.136286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d328daa-7ec0-4d29-ac68-c4e3e11d0990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:44.136913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d328daa-7ec0-4d29-ac68-c4e3e11d0990 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.137195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d328daa-7ec0-4d29-ac68-c4e3e11d0990 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.137525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d328daa-7ec0-4d29-ac68-c4e3e11d0990 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.144869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d328daa-7ec0-4d29-ac68-c4e3e11d0990 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:44.146368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d328daa-7ec0-4d29-ac68-c4e3e11d0990 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-3d328daa-7ec0-4d29-ac68-c4e3e11d0990 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:44.158925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:44.160167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:44.161388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:44.164307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 358/726] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 07:44:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:44.166313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606a3c-7501-4cbd-a1de-a5f2debbe62b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.294150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606a3c-7501-4cbd-a1de-a5f2debbe62b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.346692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada553a-2f9b-4f69-a886-3bc498f4d563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:44.347310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada553a-2f9b-4f69-a886-3bc498f4d563 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.349607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada553a-2f9b-4f69-a886-3bc498f4d563 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.349607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada553a-2f9b-4f69-a886-3bc498f4d563 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.349607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada553a-2f9b-4f69-a886-3bc498f4d563 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:44.349607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada553a-2f9b-4f69-a886-3bc498f4d563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:44.350414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada553a-2f9b-4f69-a886-3bc498f4d563 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:44.379776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 369/727] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 07:44:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:44.385501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765a38d-b84f-4620-bb33-112f7b3a14ba None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.385938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765a38d-b84f-4620-bb33-112f7b3a14ba None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.386283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765a38d-b84f-4620-bb33-112f7b3a14ba None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.388024 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 359/728] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:44.389802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada553a-2f9b-4f69-a886-3bc498f4d563 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.400685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f702271-814b-4fda-865b-19a150d49065 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.401062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f702271-814b-4fda-865b-19a150d49065 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.401406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f702271-814b-4fda-865b-19a150d49065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.421487 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-8f702271-814b-4fda-865b-19a150d49065 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:44.422918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8f702271-814b-4fda-865b-19a150d49065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:44.427668 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:44.496271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 360/729] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:44.558576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada553a-2f9b-4f69-a886-3bc498f4d563 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.596915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15505-0fa7-40b1-ba46-849c4abf9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:44.597750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15505-0fa7-40b1-ba46-849c4abf9db2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.598035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15505-0fa7-40b1-ba46-849c4abf9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.598309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15505-0fa7-40b1-ba46-849c4abf9db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.609534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba15505-0fa7-40b1-ba46-849c4abf9db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:44.611620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba15505-0fa7-40b1-ba46-849c4abf9db2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1ba15505-0fa7-40b1-ba46-849c4abf9db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:44.627828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:44.630142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:44.632267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:44.632267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:44.632267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:44.637503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 370/730] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:44.637713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f702271-814b-4fda-865b-19a150d49065 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.709869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:44.739985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f702271-814b-4fda-865b-19a150d49065 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.778312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea273a8-a78d-4de5-88d4-0dcfad5cac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:44.779054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea273a8-a78d-4de5-88d4-0dcfad5cac17 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.779211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea273a8-a78d-4de5-88d4-0dcfad5cac17 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.779444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea273a8-a78d-4de5-88d4-0dcfad5cac17 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.780096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea273a8-a78d-4de5-88d4-0dcfad5cac17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:44.780393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea273a8-a78d-4de5-88d4-0dcfad5cac17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:44.781849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea273a8-a78d-4de5-88d4-0dcfad5cac17 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:44.798829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 361/731] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:44.800781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15505-0fa7-40b1-ba46-849c4abf9db2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.846182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea273a8-a78d-4de5-88d4-0dcfad5cac17 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:44.911059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:44.938240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15505-0fa7-40b1-ba46-849c4abf9db2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.953029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:44.968464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea273a8-a78d-4de5-88d4-0dcfad5cac17 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:44.974647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3425c-5a96-4454-a666-96ae75120fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:44.975270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3425c-5a96-4454-a666-96ae75120fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.975542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3425c-5a96-4454-a666-96ae75120fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.975818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3425c-5a96-4454-a666-96ae75120fc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:44.982524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3425c-5a96-4454-a666-96ae75120fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:44.983989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3425c-5a96-4454-a666-96ae75120fc9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-14c3425c-5a96-4454-a666-96ae75120fc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:44.995884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:44.996799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:44.998132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:44.998132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:44.998132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:44.998132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:44.998132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:44.998132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:44.998132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:44.998132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:44.998132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 371/732] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:44.998630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8dc9-7c7f-493d-84ca-05e54958ce16 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:44.998708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8dc9-7c7f-493d-84ca-05e54958ce16 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:44.998962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8dc9-7c7f-493d-84ca-05e54958ce16 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.004924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 372/733] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:45.004924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64f6d-c061-4b7d-91ac-ef701c55dfb4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.004924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64f6d-c061-4b7d-91ac-ef701c55dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.004924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64f6d-c061-4b7d-91ac-ef701c55dfb4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.004924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 373/734] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:45.004924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d64f6d-c061-4b7d-91ac-ef701c55dfb4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:45.013978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61383389-eb29-4168-9032-5d0eb6af4288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:45.014689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61383389-eb29-4168-9032-5d0eb6af4288 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.015031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61383389-eb29-4168-9032-5d0eb6af4288 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.015304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61383389-eb29-4168-9032-5d0eb6af4288 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.026160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61383389-eb29-4168-9032-5d0eb6af4288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-61383389-eb29-4168-9032-5d0eb6af4288 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:45.030821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:45.031741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:45.032608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 362/735] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:45.033977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23176a-eaab-4b5a-b38a-09f59d2fdef4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.034985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23176a-eaab-4b5a-b38a-09f59d2fdef4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.034985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23176a-eaab-4b5a-b38a-09f59d2fdef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.052050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fc23176a-eaab-4b5a-b38a-09f59d2fdef4 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:45.053223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fc23176a-eaab-4b5a-b38a-09f59d2fdef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:45.119070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 363/736] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:45.120318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048444cf-9a4d-4484-ad00-412d26445ab5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.120607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048444cf-9a4d-4484-ad00-412d26445ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.120876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048444cf-9a4d-4484-ad00-412d26445ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.131761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d64f6d-c061-4b7d-91ac-ef701c55dfb4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:45.139998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-048444cf-9a4d-4484-ad00-412d26445ab5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:45.141193 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-048444cf-9a4d-4484-ad00-412d26445ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:45.167884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e965e36-80be-4b66-a077-ce3f0166770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:45.168573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e965e36-80be-4b66-a077-ce3f0166770c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.168845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e965e36-80be-4b66-a077-ce3f0166770c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.169110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e965e36-80be-4b66-a077-ce3f0166770c None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.169840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e965e36-80be-4b66-a077-ce3f0166770c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:45.170138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e965e36-80be-4b66-a077-ce3f0166770c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:45.171552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e965e36-80be-4b66-a077-ce3f0166770c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:45.173099 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:45.185014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 374/737] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:45.185907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e965e36-80be-4b66-a077-ce3f0166770c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:45.232858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 364/738] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:45.232858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0097-743d-4f2c-bc00-86d6e3f45c5b None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.232858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0097-743d-4f2c-bc00-86d6e3f45c5b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.232858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0097-743d-4f2c-bc00-86d6e3f45c5b None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.232858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 365/739] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:45.232858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b0097-743d-4f2c-bc00-86d6e3f45c5b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:45.242108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:45.302109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e965e36-80be-4b66-a077-ce3f0166770c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:45.347027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127ff8-556b-4cc2-a1ae-f3b3a841f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:45.347631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127ff8-556b-4cc2-a1ae-f3b3a841f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.347901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127ff8-556b-4cc2-a1ae-f3b3a841f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.351069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127ff8-556b-4cc2-a1ae-f3b3a841f5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.351069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127ff8-556b-4cc2-a1ae-f3b3a841f5c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:45.351069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127ff8-556b-4cc2-a1ae-f3b3a841f5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:45.351735 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b0097-743d-4f2c-bc00-86d6e3f45c5b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:45.351821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127ff8-556b-4cc2-a1ae-f3b3a841f5c5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:45.360531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 375/740] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:45.362568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949c6b-27b1-47d3-8146-c0da63deaa94 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.362874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949c6b-27b1-47d3-8146-c0da63deaa94 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.363142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949c6b-27b1-47d3-8146-c0da63deaa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.386806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d7949c6b-27b1-47d3-8146-c0da63deaa94 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:45.388167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d7949c6b-27b1-47d3-8146-c0da63deaa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:45.397269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc47f2-e410-490b-a0b2-a3537d842487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:45.397974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc47f2-e410-490b-a0b2-a3537d842487 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.398235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc47f2-e410-490b-a0b2-a3537d842487 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.398506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc47f2-e410-490b-a0b2-a3537d842487 None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/6ef753445d864a0ab30ec970446b29cd/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.400385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc47f2-e410-490b-a0b2-a3537d842487 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=6ef753445d864a0ab30ec970446b29cd, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:45.401856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc47f2-e410-490b-a0b2-a3537d842487 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:45.513513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 366/741] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:45 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/6ef753445d864a0ab30ec970446b29cd/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:45.513513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc47f2-e410-490b-a0b2-a3537d842487 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:45.517631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:45.545677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 376/742] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:45.546769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7949c6b-27b1-47d3-8146-c0da63deaa94 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:45.597999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:45.639158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc47f2-e410-490b-a0b2-a3537d842487 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:45.682517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8c4cc-f025-4a1e-943f-17c8bbdb10c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:45.685072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7949c6b-27b1-47d3-8146-c0da63deaa94 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:45.685183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c4cc-f025-4a1e-943f-17c8bbdb10c5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.685183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c4cc-f025-4a1e-943f-17c8bbdb10c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.685183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c4cc-f025-4a1e-943f-17c8bbdb10c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.705851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8c4cc-f025-4a1e-943f-17c8bbdb10c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:45.707563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8c4cc-f025-4a1e-943f-17c8bbdb10c5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:45.727861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bcb6f-6439-491c-837c-ad35638db065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:45.728542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bcb6f-6439-491c-837c-ad35638db065 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.728828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bcb6f-6439-491c-837c-ad35638db065 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.729097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bcb6f-6439-491c-837c-ad35638db065 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.729774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bcb6f-6439-491c-837c-ad35638db065 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:45.731144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bcb6f-6439-491c-837c-ad35638db065 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-79e8c4cc-f025-4a1e-943f-17c8bbdb10c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:45.732281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:45.733409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:45.734517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:45.734517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:45.734517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:45.735941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 367/743] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:45.737012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8c4cc-f025-4a1e-943f-17c8bbdb10c5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:45.836256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 377/744] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:44:45 2022] POST /identity/v3/services => generated 240 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:45.837239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bcb6f-6439-491c-837c-ad35638db065 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:45.869254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8c4cc-f025-4a1e-943f-17c8bbdb10c5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:45.898386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:45.920598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:45.942384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0851-4e14-4ecb-9810-96cc0623de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:45.944393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0851-4e14-4ecb-9810-96cc0623de0b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:45.946273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0851-4e14-4ecb-9810-96cc0623de0b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:45.946273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac0851-4e14-4ecb-9810-96cc0623de0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:45.974252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac0851-4e14-4ecb-9810-96cc0623de0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0eac0851-4e14-4ecb-9810-96cc0623de0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:45.980235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:45.981703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 368/745] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:45.988583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0851-4e14-4ecb-9810-96cc0623de0b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.031919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bcb6f-6439-491c-837c-ad35638db065 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:46.084399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cbe7-5e2c-4546-a6bf-bbad70e4eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:46.086223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cbe7-5e2c-4546-a6bf-bbad70e4eadf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.086675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cbe7-5e2c-4546-a6bf-bbad70e4eadf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.087108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03cbe7-5e2c-4546-a6bf-bbad70e4eadf None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.087932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cbe7-5e2c-4546-a6bf-bbad70e4eadf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:46.088395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cbe7-5e2c-4546-a6bf-bbad70e4eadf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:46.090166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03cbe7-5e2c-4546-a6bf-bbad70e4eadf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:46.109026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 378/746] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:46.110340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cbe7-5e2c-4546-a6bf-bbad70e4eadf None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.124646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac0851-4e14-4ecb-9810-96cc0623de0b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:46.174217 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad7410-7d3c-4225-83a2-be5e12434048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:46.174911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad7410-7d3c-4225-83a2-be5e12434048 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.175351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad7410-7d3c-4225-83a2-be5e12434048 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.175657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad7410-7d3c-4225-83a2-be5e12434048 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.176412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad7410-7d3c-4225-83a2-be5e12434048 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:46.178542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad7410-7d3c-4225-83a2-be5e12434048 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:46.234794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03cbe7-5e2c-4546-a6bf-bbad70e4eadf None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:46.244884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:46.262251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 369/747] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:44:45 2022] POST /identity/v3/services => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:46.262251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad7410-7d3c-4225-83a2-be5e12434048 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.312932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e7bc8-2d65-442c-8a0a-ef7c27dc7ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:46.314753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e7bc8-2d65-442c-8a0a-ef7c27dc7ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.315264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e7bc8-2d65-442c-8a0a-ef7c27dc7ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.318565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e7bc8-2d65-442c-8a0a-ef7c27dc7ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.318565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e7bc8-2d65-442c-8a0a-ef7c27dc7ad2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:46.318565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e7bc8-2d65-442c-8a0a-ef7c27dc7ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:46.321164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e7bc8-2d65-442c-8a0a-ef7c27dc7ad2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:46.347291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 379/748] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:46.353772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e7bc8-2d65-442c-8a0a-ef7c27dc7ad2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.360292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:46.468495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad7410-7d3c-4225-83a2-be5e12434048 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:46.527413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2432a3-9547-4699-8f9d-6cedb4c981e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:46.528814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2432a3-9547-4699-8f9d-6cedb4c981e5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.529564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2432a3-9547-4699-8f9d-6cedb4c981e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.530326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2432a3-9547-4699-8f9d-6cedb4c981e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.541312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2432a3-9547-4699-8f9d-6cedb4c981e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:46.543116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2432a3-9547-4699-8f9d-6cedb4c981e5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-bf2432a3-9547-4699-8f9d-6cedb4c981e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:46.564241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:46.565261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:46.566255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:46.568825 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 370/749] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:46.575770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2432a3-9547-4699-8f9d-6cedb4c981e5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.582487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e7bc8-2d65-442c-8a0a-ef7c27dc7ad2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:46.634025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf5006-d229-4a46-b1ec-0666b05de742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:46.634661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf5006-d229-4a46-b1ec-0666b05de742 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.634932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf5006-d229-4a46-b1ec-0666b05de742 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.635200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf5006-d229-4a46-b1ec-0666b05de742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.670591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf5006-d229-4a46-b1ec-0666b05de742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:46.672401 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf5006-d229-4a46-b1ec-0666b05de742 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:46.692850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f7bf5006-d229-4a46-b1ec-0666b05de742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:46.695035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:46.695943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:46.696847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:46.696847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:46.696847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:46.698910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 380/750] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:46.704250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf5006-d229-4a46-b1ec-0666b05de742 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.717995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2432a3-9547-4699-8f9d-6cedb4c981e5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:46.729898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:46.795180 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb322dd-2e85-4826-8fcc-b6bf0f45c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:46.795806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb322dd-2e85-4826-8fcc-b6bf0f45c8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.796084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb322dd-2e85-4826-8fcc-b6bf0f45c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.796353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb322dd-2e85-4826-8fcc-b6bf0f45c8e6 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.797099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb322dd-2e85-4826-8fcc-b6bf0f45c8e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:46.797403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb322dd-2e85-4826-8fcc-b6bf0f45c8e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:46.799426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb322dd-2e85-4826-8fcc-b6bf0f45c8e6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:46.835598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf5006-d229-4a46-b1ec-0666b05de742 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:46.837147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 371/751] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:46.843634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb322dd-2e85-4826-8fcc-b6bf0f45c8e6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.911935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c313f-7061-4ee0-949b-60a89b309066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:46.912424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c313f-7061-4ee0-949b-60a89b309066 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:46.912699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c313f-7061-4ee0-949b-60a89b309066 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:46.912967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c313f-7061-4ee0-949b-60a89b309066 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:46.913641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c313f-7061-4ee0-949b-60a89b309066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:46.913976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c313f-7061-4ee0-949b-60a89b309066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:46.915310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c313f-7061-4ee0-949b-60a89b309066 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:46.938709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 381/752] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:46.944971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c313f-7061-4ee0-949b-60a89b309066 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:46.976750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb322dd-2e85-4826-8fcc-b6bf0f45c8e6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.015428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd335e0d-9e8e-469a-89c8-27576b1f3992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.016365 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd335e0d-9e8e-469a-89c8-27576b1f3992 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.016832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd335e0d-9e8e-469a-89c8-27576b1f3992 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.017878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd335e0d-9e8e-469a-89c8-27576b1f3992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.042802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.092537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd335e0d-9e8e-469a-89c8-27576b1f3992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.095820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd335e0d-9e8e-469a-89c8-27576b1f3992 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.123406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.191760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c313f-7061-4ee0-949b-60a89b309066 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.207148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 372/753] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:47.212552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd335e0d-9e8e-469a-89c8-27576b1f3992 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.268961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.286841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fb1b9-fb7f-4390-b5dd-aafa9a401b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.287490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb1b9-fb7f-4390-b5dd-aafa9a401b27 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.287757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb1b9-fb7f-4390-b5dd-aafa9a401b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.288025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb1b9-fb7f-4390-b5dd-aafa9a401b27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.306669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fb1b9-fb7f-4390-b5dd-aafa9a401b27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.306669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fb1b9-fb7f-4390-b5dd-aafa9a401b27 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7c2fb1b9-fb7f-4390-b5dd-aafa9a401b27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:47.322517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:47.323496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:47.324421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 382/754] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:44:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:47.334373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fb1b9-fb7f-4390-b5dd-aafa9a401b27 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.341895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd335e0d-9e8e-469a-89c8-27576b1f3992 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.381216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdaddd-8bfe-4ae6-aac6-649dc33de056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.382149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdaddd-8bfe-4ae6-aac6-649dc33de056 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.382522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdaddd-8bfe-4ae6-aac6-649dc33de056 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.382886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdaddd-8bfe-4ae6-aac6-649dc33de056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.394500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdaddd-8bfe-4ae6-aac6-649dc33de056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.396289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdaddd-8bfe-4ae6-aac6-649dc33de056 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d9cdaddd-8bfe-4ae6-aac6-649dc33de056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:47.412452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:47.413414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:47.414437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:47.414437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:47.414437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:47.414437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 373/755] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:47.419116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdaddd-8bfe-4ae6-aac6-649dc33de056 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.512530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fb1b9-fb7f-4390-b5dd-aafa9a401b27 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.551747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a34b4-fa3e-412c-b403-b59110727762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.552361 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a34b4-fa3e-412c-b403-b59110727762 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.552635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a34b4-fa3e-412c-b403-b59110727762 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.552897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a34b4-fa3e-412c-b403-b59110727762 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.553798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a34b4-fa3e-412c-b403-b59110727762 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:47.554104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a34b4-fa3e-412c-b403-b59110727762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.555669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a34b4-fa3e-412c-b403-b59110727762 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.558688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.576858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 383/756] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:47.586565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a34b4-fa3e-412c-b403-b59110727762 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.641626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdaddd-8bfe-4ae6-aac6-649dc33de056 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.645793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.714290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3025063-dedd-4daa-8052-b6d18f229f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.714916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3025063-dedd-4daa-8052-b6d18f229f66 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.715191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3025063-dedd-4daa-8052-b6d18f229f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.715468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3025063-dedd-4daa-8052-b6d18f229f66 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.716122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3025063-dedd-4daa-8052-b6d18f229f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:47.716427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3025063-dedd-4daa-8052-b6d18f229f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.717853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3025063-dedd-4daa-8052-b6d18f229f66 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.735181 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 374/757] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:47.737305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a694a-4ea3-4a65-b6c2-39f5dd7d2f7e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.737617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a694a-4ea3-4a65-b6c2-39f5dd7d2f7e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.737893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a694a-4ea3-4a65-b6c2-39f5dd7d2f7e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.741801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 375/758] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:47.744731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a694a-4ea3-4a65-b6c2-39f5dd7d2f7e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:47.754588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a34b4-fa3e-412c-b403-b59110727762 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:47.795547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173157f-38c6-44f3-88aa-b421093d662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:47.796500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173157f-38c6-44f3-88aa-b421093d662f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.796960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173157f-38c6-44f3-88aa-b421093d662f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.797410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173157f-38c6-44f3-88aa-b421093d662f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:47.871298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:47.880487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173157f-38c6-44f3-88aa-b421093d662f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:47.882084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173157f-38c6-44f3-88aa-b421093d662f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:47.997082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 384/759] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:47.998551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dd817-3bb7-4766-8358-e473de03724d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:47.998910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dd817-3bb7-4766-8358-e473de03724d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:47.999262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dd817-3bb7-4766-8358-e473de03724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.005041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a694a-4ea3-4a65-b6c2-39f5dd7d2f7e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.028520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-761dd817-3bb7-4766-8358-e473de03724d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:48.030000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-761dd817-3bb7-4766-8358-e473de03724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:48.042938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf4880-e83c-498d-9068-e1a42691903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.043690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf4880-e83c-498d-9068-e1a42691903d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.044036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf4880-e83c-498d-9068-e1a42691903d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.044379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf4880-e83c-498d-9068-e1a42691903d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.051956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf4880-e83c-498d-9068-e1a42691903d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.053515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf4880-e83c-498d-9068-e1a42691903d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1eaf4880-e83c-498d-9068-e1a42691903d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:48.066177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:48.067141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:48.068050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:48.068050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:48.068050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:48.068050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:48.068050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:48.068050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:48.068050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:48.068050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:48.069064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 376/760] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:48.070407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf4880-e83c-498d-9068-e1a42691903d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.099201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.110655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 385/761] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:44:48.112257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e83d1-30cb-4057-a3d9-1f3b4b76f1a3 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.112708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e83d1-30cb-4057-a3d9-1f3b4b76f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.113110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e83d1-30cb-4057-a3d9-1f3b4b76f1a3 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.118717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 386/762] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:48.119637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e83d1-30cb-4057-a3d9-1f3b4b76f1a3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.153787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.193238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf4880-e83c-498d-9068-e1a42691903d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.228959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e83d1-30cb-4057-a3d9-1f3b4b76f1a3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.236284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866ac0a-d9a8-4b22-821e-b738b138b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.236923 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866ac0a-d9a8-4b22-821e-b738b138b3dc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.237201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866ac0a-d9a8-4b22-821e-b738b138b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.237490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866ac0a-d9a8-4b22-821e-b738b138b3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.250778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866ac0a-d9a8-4b22-821e-b738b138b3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.252708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866ac0a-d9a8-4b22-821e-b738b138b3dc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.266411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e13c9d-f6fd-4a10-bb72-2c90348de189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.268004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e13c9d-f6fd-4a10-bb72-2c90348de189 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.268495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e13c9d-f6fd-4a10-bb72-2c90348de189 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.268995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e13c9d-f6fd-4a10-bb72-2c90348de189 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.269899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e13c9d-f6fd-4a10-bb72-2c90348de189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:48.270379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e13c9d-f6fd-4a10-bb72-2c90348de189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-8866ac0a-d9a8-4b22-821e-b738b138b3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:48.270745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:48.271712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:48.272638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:48.272638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:48.272638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:48.275691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e13c9d-f6fd-4a10-bb72-2c90348de189 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.276600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 377/763] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:48.277883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579fa39-7e81-4dee-9778-a82ca3855ebf None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.278370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579fa39-7e81-4dee-9778-a82ca3855ebf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.278658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579fa39-7e81-4dee-9778-a82ca3855ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.292383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 387/764] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:48.293550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e13c9d-f6fd-4a10-bb72-2c90348de189 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.309692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0579fa39-7e81-4dee-9778-a82ca3855ebf None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:48.310903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0579fa39-7e81-4dee-9778-a82ca3855ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:48.391211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.406360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 378/765] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:44:48.408050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579fa39-7e81-4dee-9778-a82ca3855ebf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.410074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e13c9d-f6fd-4a10-bb72-2c90348de189 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.421612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.460611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa86d5-3472-4d55-9cb2-e9089094a206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.461334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa86d5-3472-4d55-9cb2-e9089094a206 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.461731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa86d5-3472-4d55-9cb2-e9089094a206 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.462086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa86d5-3472-4d55-9cb2-e9089094a206 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.462914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa86d5-3472-4d55-9cb2-e9089094a206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:48.463207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa86d5-3472-4d55-9cb2-e9089094a206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.465286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa86d5-3472-4d55-9cb2-e9089094a206 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.485418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 388/766] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:48.487009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa86d5-3472-4d55-9cb2-e9089094a206 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.523261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579fa39-7e81-4dee-9778-a82ca3855ebf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.559444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d2486-fa3d-4005-b0f5-7828858a4721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.560380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d2486-fa3d-4005-b0f5-7828858a4721 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.560912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d2486-fa3d-4005-b0f5-7828858a4721 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.561384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d2486-fa3d-4005-b0f5-7828858a4721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.562342 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d2486-fa3d-4005-b0f5-7828858a4721 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=f362b8daae13435a9a468b06c4998c67) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:48.562928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d2486-fa3d-4005-b0f5-7828858a4721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.565081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d2486-fa3d-4005-b0f5-7828858a4721 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.571252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 379/767] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/role_assignments?user.id=f362b8daae13435a9a468b06c4998c67&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:48.572348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d2486-fa3d-4005-b0f5-7828858a4721 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.649806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa86d5-3472-4d55-9cb2-e9089094a206 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.701346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.704001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f319b74-8e5e-4170-bcfe-d46fe4668238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.705342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f319b74-8e5e-4170-bcfe-d46fe4668238 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.705734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f319b74-8e5e-4170-bcfe-d46fe4668238 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.706167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f319b74-8e5e-4170-bcfe-d46fe4668238 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.721835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f319b74-8e5e-4170-bcfe-d46fe4668238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2f319b74-8e5e-4170-bcfe-d46fe4668238 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:48.730180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:48.731311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:48.732163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 389/768] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:48.732859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b22c-78eb-4ae4-bda1-4825463ffb99 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.733619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b22c-78eb-4ae4-bda1-4825463ffb99 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.733619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891b22c-78eb-4ae4-bda1-4825463ffb99 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.737535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 390/769] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:48.737535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b22c-78eb-4ae4-bda1-4825463ffb99 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.741436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.745355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d2486-fa3d-4005-b0f5-7828858a4721 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.781449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546a222-7f57-4125-92ba-a250269fccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.782284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546a222-7f57-4125-92ba-a250269fccf5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.783215 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546a222-7f57-4125-92ba-a250269fccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.783582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546a222-7f57-4125-92ba-a250269fccf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.790971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546a222-7f57-4125-92ba-a250269fccf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.792521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546a222-7f57-4125-92ba-a250269fccf5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f546a222-7f57-4125-92ba-a250269fccf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:48.804493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:48.805686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:48.806811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:48.806811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:48.806811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:48.806811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:48.806811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:48.806811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:48.806811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:48.806811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:48.806811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 380/770] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:48.807413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546a222-7f57-4125-92ba-a250269fccf5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:48.865970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891b22c-78eb-4ae4-bda1-4825463ffb99 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.903053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea805e-4f24-4a99-ac75-28d8799961c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.903680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea805e-4f24-4a99-ac75-28d8799961c6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.903953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea805e-4f24-4a99-ac75-28d8799961c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.904219 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea805e-4f24-4a99-ac75-28d8799961c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.904788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea805e-4f24-4a99-ac75-28d8799961c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.906170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea805e-4f24-4a99-ac75-28d8799961c6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.914926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546a222-7f57-4125-92ba-a250269fccf5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d7ea805e-4f24-4a99-ac75-28d8799961c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:48.919066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:48.920073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:48.920918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 391/771] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:48.922775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2ec25-a153-4fb9-8e20-ce5217d243e9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.923056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2ec25-a153-4fb9-8e20-ce5217d243e9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.923357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2ec25-a153-4fb9-8e20-ce5217d243e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.940530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f3e2ec25-a153-4fb9-8e20-ce5217d243e9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:48.941731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f3e2ec25-a153-4fb9-8e20-ce5217d243e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:48.949774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:48.956482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88f8c7-d5c4-4526-a071-4d662bb8783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:48.957130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88f8c7-d5c4-4526-a071-4d662bb8783a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:48.957415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88f8c7-d5c4-4526-a071-4d662bb8783a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:48.962781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88f8c7-d5c4-4526-a071-4d662bb8783a None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:48.962781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88f8c7-d5c4-4526-a071-4d662bb8783a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:48.962781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88f8c7-d5c4-4526-a071-4d662bb8783a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:48.962781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88f8c7-d5c4-4526-a071-4d662bb8783a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:48.973962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 381/772] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:48.973962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88f8c7-d5c4-4526-a071-4d662bb8783a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.009217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.015046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 392/773] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:44:49.020667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2ec25-a153-4fb9-8e20-ce5217d243e9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.101744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88f8c7-d5c4-4526-a071-4d662bb8783a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.130232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2ec25-a153-4fb9-8e20-ce5217d243e9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.154052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2be59-e55d-48b7-94a7-f07cd9e602d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.154667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2be59-e55d-48b7-94a7-f07cd9e602d4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.154948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2be59-e55d-48b7-94a7-f07cd9e602d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.155225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2be59-e55d-48b7-94a7-f07cd9e602d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.156190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2be59-e55d-48b7-94a7-f07cd9e602d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:49.156499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2be59-e55d-48b7-94a7-f07cd9e602d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.158780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2be59-e55d-48b7-94a7-f07cd9e602d4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.168813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f04c4f-cc6b-483d-97f7-658f7996225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.169821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f04c4f-cc6b-483d-97f7-658f7996225b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.170302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f04c4f-cc6b-483d-97f7-658f7996225b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.170783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f04c4f-cc6b-483d-97f7-658f7996225b None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.171609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f04c4f-cc6b-483d-97f7-658f7996225b None admin] RBAC: Adding query filter params (name=network) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:49.172110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f04c4f-cc6b-483d-97f7-658f7996225b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.173276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 382/774] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.174045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f04c4f-cc6b-483d-97f7-658f7996225b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.174168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2be59-e55d-48b7-94a7-f07cd9e602d4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.184387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 393/775] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.185535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f04c4f-cc6b-483d-97f7-658f7996225b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.236891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.268853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.289075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2be59-e55d-48b7-94a7-f07cd9e602d4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.317378 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f04c4f-cc6b-483d-97f7-658f7996225b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.327838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34281797-67a4-4ad4-a804-2dd3966d6cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.328467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34281797-67a4-4ad4-a804-2dd3966d6cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.328745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34281797-67a4-4ad4-a804-2dd3966d6cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.329016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34281797-67a4-4ad4-a804-2dd3966d6cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.339983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34281797-67a4-4ad4-a804-2dd3966d6cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.341423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34281797-67a4-4ad4-a804-2dd3966d6cf1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-34281797-67a4-4ad4-a804-2dd3966d6cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:49.356502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:49.357693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:49.358751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:49.358751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:49.358751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:49.358751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 383/776] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:49.364041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae24e4-a005-43df-af67-a501d3b34bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.364639 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34281797-67a4-4ad4-a804-2dd3966d6cf1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.364872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae24e4-a005-43df-af67-a501d3b34bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.365240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae24e4-a005-43df-af67-a501d3b34bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.365727 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae24e4-a005-43df-af67-a501d3b34bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.366637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae24e4-a005-43df-af67-a501d3b34bd6 None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=97a62895f65f4e6aaa23d2941ed43d79) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:49.367032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae24e4-a005-43df-af67-a501d3b34bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.369030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae24e4-a005-43df-af67-a501d3b34bd6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.381517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 394/777] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/role_assignments?user.id=97a62895f65f4e6aaa23d2941ed43d79&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.381517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae24e4-a005-43df-af67-a501d3b34bd6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.515389 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae24e4-a005-43df-af67-a501d3b34bd6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.518997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34281797-67a4-4ad4-a804-2dd3966d6cf1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.523137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.550548 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.565204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff514f-16af-4dd7-bcda-29cb423bbcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.566121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff514f-16af-4dd7-bcda-29cb423bbcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.566553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff514f-16af-4dd7-bcda-29cb423bbcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.567050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff514f-16af-4dd7-bcda-29cb423bbcd0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.567882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff514f-16af-4dd7-bcda-29cb423bbcd0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.568449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38a707-b6c2-476a-b83e-93fd231fa745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.569061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38a707-b6c2-476a-b83e-93fd231fa745 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.569336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38a707-b6c2-476a-b83e-93fd231fa745 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.569758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38a707-b6c2-476a-b83e-93fd231fa745 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.570312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38a707-b6c2-476a-b83e-93fd231fa745 None admin] RBAC: Adding query filter params (type=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:49.570478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff514f-16af-4dd7-bcda-29cb423bbcd0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.570611 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38a707-b6c2-476a-b83e-93fd231fa745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.571961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38a707-b6c2-476a-b83e-93fd231fa745 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.577649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 384/778] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.578466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38a707-b6c2-476a-b83e-93fd231fa745 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d5ff514f-16af-4dd7-bcda-29cb423bbcd0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:49.583807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:49.584900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:44:49.585779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:49.588541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 395/779] 10.222.0.58 () {56 vars in 1129 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:49.589593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff514f-16af-4dd7-bcda-29cb423bbcd0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.685263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38a707-b6c2-476a-b83e-93fd231fa745 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.723772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364f775-c8b7-45c0-a2be-224c2bc80d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.724375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364f775-c8b7-45c0-a2be-224c2bc80d39 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.724648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364f775-c8b7-45c0-a2be-224c2bc80d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.724913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364f775-c8b7-45c0-a2be-224c2bc80d39 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.725586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364f775-c8b7-45c0-a2be-224c2bc80d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:49.725882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364f775-c8b7-45c0-a2be-224c2bc80d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.727232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364f775-c8b7-45c0-a2be-224c2bc80d39 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.738498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff514f-16af-4dd7-bcda-29cb423bbcd0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.740374 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 385/780] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.741300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364f775-c8b7-45c0-a2be-224c2bc80d39 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.773843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.787801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be85d3a-bd00-4213-842f-f4023562f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.789006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85d3a-bd00-4213-842f-f4023562f1de None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.789459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85d3a-bd00-4213-842f-f4023562f1de None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.789900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85d3a-bd00-4213-842f-f4023562f1de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.791306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be85d3a-bd00-4213-842f-f4023562f1de None admin] RBAC: Adding query filter params (interface=public, service_id=0b48f2d0afa04eee98de9aa2a71a55f1, region_id=RegionOne) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:49.791763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be85d3a-bd00-4213-842f-f4023562f1de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.793891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be85d3a-bd00-4213-842f-f4023562f1de None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.804838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 396/781] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/endpoints?service_id=0b48f2d0afa04eee98de9aa2a71a55f1&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.806786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be85d3a-bd00-4213-842f-f4023562f1de None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.855420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364f775-c8b7-45c0-a2be-224c2bc80d39 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.875179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.902570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c150ecc-7bc8-444a-979f-3b37729957e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.903857 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c150ecc-7bc8-444a-979f-3b37729957e7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.904329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c150ecc-7bc8-444a-979f-3b37729957e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.905779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c150ecc-7bc8-444a-979f-3b37729957e7 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.906850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c150ecc-7bc8-444a-979f-3b37729957e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:49.907303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c150ecc-7bc8-444a-979f-3b37729957e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.910080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c150ecc-7bc8-444a-979f-3b37729957e7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.917030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 386/782] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:49.918297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c150ecc-7bc8-444a-979f-3b37729957e7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:49.928196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be85d3a-bd00-4213-842f-f4023562f1de None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:49.968549 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4c106-e359-4c8d-82ac-73e54b998f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:49.969254 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4c106-e359-4c8d-82ac-73e54b998f9a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:49.969570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4c106-e359-4c8d-82ac-73e54b998f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:49.969889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4c106-e359-4c8d-82ac-73e54b998f9a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:49.978538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4c106-e359-4c8d-82ac-73e54b998f9a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:49.979953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4c106-e359-4c8d-82ac-73e54b998f9a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-dea4c106-e359-4c8d-82ac-73e54b998f9a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:49.992311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:49.993286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 397/783] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:49.994658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4c106-e359-4c8d-82ac-73e54b998f9a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.045336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.058453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c150ecc-7bc8-444a-979f-3b37729957e7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.096746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dfc64-6791-4cb2-9ded-5353a7091357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.097518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dfc64-6791-4cb2-9ded-5353a7091357 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.097845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dfc64-6791-4cb2-9ded-5353a7091357 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.098190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dfc64-6791-4cb2-9ded-5353a7091357 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.098873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dfc64-6791-4cb2-9ded-5353a7091357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.100393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dfc64-6791-4cb2-9ded-5353a7091357 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.112743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 387/784] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:50.113587 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dfc64-6791-4cb2-9ded-5353a7091357 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.124065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4c106-e359-4c8d-82ac-73e54b998f9a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.141270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.168408 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628347e-ea99-4ab8-8fc6-33f9cddca5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.169342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628347e-ea99-4ab8-8fc6-33f9cddca5ac None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.170276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628347e-ea99-4ab8-8fc6-33f9cddca5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.170731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628347e-ea99-4ab8-8fc6-33f9cddca5ac None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.171811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628347e-ea99-4ab8-8fc6-33f9cddca5ac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:50.172329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628347e-ea99-4ab8-8fc6-33f9cddca5ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.174940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628347e-ea99-4ab8-8fc6-33f9cddca5ac None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.181701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 398/785] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 07:44:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:50.188141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628347e-ea99-4ab8-8fc6-33f9cddca5ac None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.317397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628347e-ea99-4ab8-8fc6-33f9cddca5ac None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.360198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5f04-b739-4754-9968-d0c915bd7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.361490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5f04-b739-4754-9968-d0c915bd7fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.361985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5f04-b739-4754-9968-d0c915bd7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.362685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5f04-b739-4754-9968-d0c915bd7fe0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.363614 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f5f04-b739-4754-9968-d0c915bd7fe0 None admin] RBAC: Adding query filter params (interface=public, service_id=837505d997c9438380c78f6955efc20d, region_id=RegionOne) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:50.364144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f5f04-b739-4754-9968-d0c915bd7fe0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.367036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f5f04-b739-4754-9968-d0c915bd7fe0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.374200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 399/786] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/endpoints?service_id=837505d997c9438380c78f6955efc20d&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:50.379238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dfc64-6791-4cb2-9ded-5353a7091357 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.380083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5f04-b739-4754-9968-d0c915bd7fe0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.427173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5bec-358e-4d9f-9ece-a8a9786c04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.429267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5bec-358e-4d9f-9ece-a8a9786c04d2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.429798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5bec-358e-4d9f-9ece-a8a9786c04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.430294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5bec-358e-4d9f-9ece-a8a9786c04d2 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.431399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5bec-358e-4d9f-9ece-a8a9786c04d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:50.431901 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5bec-358e-4d9f-9ece-a8a9786c04d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.433566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5bec-358e-4d9f-9ece-a8a9786c04d2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.439305 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.460830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 388/787] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:50.467455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5bec-358e-4d9f-9ece-a8a9786c04d2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.487721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.524181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5f04-b739-4754-9968-d0c915bd7fe0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.569818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dc07a-26c2-4c18-a089-269383721b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.570996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc07a-26c2-4c18-a089-269383721b58 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.571466 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc07a-26c2-4c18-a089-269383721b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.572400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc07a-26c2-4c18-a089-269383721b58 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.573454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dc07a-26c2-4c18-a089-269383721b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.575278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dc07a-26c2-4c18-a089-269383721b58 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.584138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 400/788] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:50.605563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5bec-358e-4d9f-9ece-a8a9786c04d2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:50.645946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9dbd-e07f-4ef9-a049-4178a601dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:50.646861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9dbd-e07f-4ef9-a049-4178a601dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.647331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9dbd-e07f-4ef9-a049-4178a601dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.647777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d9dbd-e07f-4ef9-a049-4178a601dbf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.649722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f1bd7-fbb8-4a59-9ada-8ed0795a50f4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.650183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f1bd7-fbb8-4a59-9ada-8ed0795a50f4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.650636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f1bd7-fbb8-4a59-9ada-8ed0795a50f4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.652137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 401/789] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:50.657808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85ec4-2e80-4d0f-ace8-369d7a449d7f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:50.658195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85ec4-2e80-4d0f-ace8-369d7a449d7f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:50.658539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85ec4-2e80-4d0f-ace8-369d7a449d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:50.712052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0cd85ec4-2e80-4d0f-ace8-369d7a449d7f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:50.713418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0cd85ec4-2e80-4d0f-ace8-369d7a449d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:50.737412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d9dbd-e07f-4ef9-a049-4178a601dbf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:50.739647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d9dbd-e07f-4ef9-a049-4178a601dbf0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:50.766695 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.836658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 402/790] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:44:50.869630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 389/791] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:44:50.874857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85ec4-2e80-4d0f-ace8-369d7a449d7f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:50.918231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:50.988180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85ec4-2e80-4d0f-ace8-369d7a449d7f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.026402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0892c4b-a8ed-4b46-8403-ef9f25edff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.027032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0892c4b-a8ed-4b46-8403-ef9f25edff99 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.027302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0892c4b-a8ed-4b46-8403-ef9f25edff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.027569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0892c4b-a8ed-4b46-8403-ef9f25edff99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.038577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0892c4b-a8ed-4b46-8403-ef9f25edff99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.040156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0892c4b-a8ed-4b46-8403-ef9f25edff99 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d0892c4b-a8ed-4b46-8403-ef9f25edff99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:51.056212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:51.057200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:51.058145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:51.058145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:51.058145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:51.058145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 403/792] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:51.066593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9dbd-e07f-4ef9-a049-4178a601dbf0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.206938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0892c4b-a8ed-4b46-8403-ef9f25edff99 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.209786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d9dbd-e07f-4ef9-a049-4178a601dbf0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.232873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:51.258023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c04e64-5630-444b-b74f-393caaf52e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.258643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c04e64-5630-444b-b74f-393caaf52e5d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.258974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c04e64-5630-444b-b74f-393caaf52e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.259255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c04e64-5630-444b-b74f-393caaf52e5d None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.259990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c04e64-5630-444b-b74f-393caaf52e5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:51.260399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c04e64-5630-444b-b74f-393caaf52e5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.261785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c04e64-5630-444b-b74f-393caaf52e5d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.275844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 390/793] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:51.281295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c04e64-5630-444b-b74f-393caaf52e5d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.302881 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:51.316001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0892c4b-a8ed-4b46-8403-ef9f25edff99 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.356317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74add4c-3876-43eb-80b6-f648e535c9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.356317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74add4c-3876-43eb-80b6-f648e535c9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.356317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74add4c-3876-43eb-80b6-f648e535c9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.356317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74add4c-3876-43eb-80b6-f648e535c9f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.368503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74add4c-3876-43eb-80b6-f648e535c9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-c74add4c-3876-43eb-80b6-f648e535c9f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:51.373425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:51.374494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:51.375371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:51.382619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 404/794] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:51.383991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74add4c-3876-43eb-80b6-f648e535c9f2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.488053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74add4c-3876-43eb-80b6-f648e535c9f2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.532228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c04e64-5630-444b-b74f-393caaf52e5d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.542994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0328f-97a2-4a7c-b3bc-5a7cf587cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.543618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0328f-97a2-4a7c-b3bc-5a7cf587cb72 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.543898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0328f-97a2-4a7c-b3bc-5a7cf587cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.544166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0328f-97a2-4a7c-b3bc-5a7cf587cb72 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.544838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0328f-97a2-4a7c-b3bc-5a7cf587cb72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:51.545138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0328f-97a2-4a7c-b3bc-5a7cf587cb72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.546547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0328f-97a2-4a7c-b3bc-5a7cf587cb72 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.562136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 405/795] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:51.564183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22557-2ce8-45d2-b1ae-95ab9cc2fa60 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.564515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22557-2ce8-45d2-b1ae-95ab9cc2fa60 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.564983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22557-2ce8-45d2-b1ae-95ab9cc2fa60 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.566530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 406/796] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:51.569121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e22557-2ce8-45d2-b1ae-95ab9cc2fa60 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.584149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:51.595138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34bf16-989a-4f1b-8062-fd1c0f008de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.596507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34bf16-989a-4f1b-8062-fd1c0f008de6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.596983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34bf16-989a-4f1b-8062-fd1c0f008de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.597592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34bf16-989a-4f1b-8062-fd1c0f008de6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.607625 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34bf16-989a-4f1b-8062-fd1c0f008de6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.610262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34bf16-989a-4f1b-8062-fd1c0f008de6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-fd34bf16-989a-4f1b-8062-fd1c0f008de6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:51.624640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:51.625620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:51.627349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:51.627349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:51.627349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:51.627349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:51.627349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:51.627349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:51.627349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:51.627349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:51.628684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 391/797] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:51.628684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e070-ad3b-461c-9476-05f9d8ae70dc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.628959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e070-ad3b-461c-9476-05f9d8ae70dc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.632383 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e070-ad3b-461c-9476-05f9d8ae70dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.651036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-bb95e070-ad3b-461c-9476-05f9d8ae70dc None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:51.652214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bb95e070-ad3b-461c-9476-05f9d8ae70dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:51.682298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:51.698580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e22557-2ce8-45d2-b1ae-95ab9cc2fa60 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.737816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 392/798] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:44:51.739272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e070-ad3b-461c-9476-05f9d8ae70dc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.748081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8941fb-97b9-4f29-8878-40f83d42c199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.748927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8941fb-97b9-4f29-8878-40f83d42c199 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.749378 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8941fb-97b9-4f29-8878-40f83d42c199 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.749840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8941fb-97b9-4f29-8878-40f83d42c199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.762396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8941fb-97b9-4f29-8878-40f83d42c199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.764178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8941fb-97b9-4f29-8878-40f83d42c199 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4b8941fb-97b9-4f29-8878-40f83d42c199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:51.781283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:51.782261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:51.783854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:51.783854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:51.783854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:51.790935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 407/799] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:51.792422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8941fb-97b9-4f29-8878-40f83d42c199 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.857174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:51.900634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8941fb-97b9-4f29-8878-40f83d42c199 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.919135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e070-ad3b-461c-9476-05f9d8ae70dc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:51.940934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b61e6e-5976-49d5-9c58-bb3e22185f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.941934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b61e6e-5976-49d5-9c58-bb3e22185f24 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.942416 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b61e6e-5976-49d5-9c58-bb3e22185f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.942934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b61e6e-5976-49d5-9c58-bb3e22185f24 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.943866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b61e6e-5976-49d5-9c58-bb3e22185f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:51.944423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b61e6e-5976-49d5-9c58-bb3e22185f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.946058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b61e6e-5976-49d5-9c58-bb3e22185f24 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.956522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd828ff1-0b19-48a9-a6a6-77d356972a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:51.956522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd828ff1-0b19-48a9-a6a6-77d356972a14 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:51.956805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd828ff1-0b19-48a9-a6a6-77d356972a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:51.957045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd828ff1-0b19-48a9-a6a6-77d356972a14 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:51.957781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd828ff1-0b19-48a9-a6a6-77d356972a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:51.958080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd828ff1-0b19-48a9-a6a6-77d356972a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:51.960029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd828ff1-0b19-48a9-a6a6-77d356972a14 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:51.968440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 408/800] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:51.970771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b61e6e-5976-49d5-9c58-bb3e22185f24 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:51.972897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 393/801] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:51.982476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd828ff1-0b19-48a9-a6a6-77d356972a14 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.027695 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.138473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd828ff1-0b19-48a9-a6a6-77d356972a14 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.146154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b61e6e-5976-49d5-9c58-bb3e22185f24 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.172701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.184508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6c7cb-b5dd-4ec6-9f08-7b72769e0ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.185139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6c7cb-b5dd-4ec6-9f08-7b72769e0ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.185420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6c7cb-b5dd-4ec6-9f08-7b72769e0ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.185731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6c7cb-b5dd-4ec6-9f08-7b72769e0ca7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.190812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f7f30-4e43-4694-928e-7cdcb319423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.191745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f7f30-4e43-4694-928e-7cdcb319423b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.192225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f7f30-4e43-4694-928e-7cdcb319423b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.192983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f7f30-4e43-4694-928e-7cdcb319423b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.193549 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6c7cb-b5dd-4ec6-9f08-7b72769e0ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.194163 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f7f30-4e43-4694-928e-7cdcb319423b None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=6ef753445d864a0ab30ec970446b29cd) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:52.194696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f7f30-4e43-4694-928e-7cdcb319423b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.195001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6c7cb-b5dd-4ec6-9f08-7b72769e0ca7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.196863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f7f30-4e43-4694-928e-7cdcb319423b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.205153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 394/802] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/role_assignments?user.id=6ef753445d864a0ab30ec970446b29cd&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:52.207061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f7f30-4e43-4694-928e-7cdcb319423b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b5e6c7cb-b5dd-4ec6-9f08-7b72769e0ca7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:52.208533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:52.209454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:52.211076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:52.213606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 409/803] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:52.215972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6c7cb-b5dd-4ec6-9f08-7b72769e0ca7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.332162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.360224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6c7cb-b5dd-4ec6-9f08-7b72769e0ca7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.364101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f7f30-4e43-4694-928e-7cdcb319423b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.403778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb22c4a-b857-4f19-9a33-07b4299eff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.404898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb22c4a-b857-4f19-9a33-07b4299eff75 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.405176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb22c4a-b857-4f19-9a33-07b4299eff75 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.405446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb22c4a-b857-4f19-9a33-07b4299eff75 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.406278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb22c4a-b857-4f19-9a33-07b4299eff75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:52.406586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb22c4a-b857-4f19-9a33-07b4299eff75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.408649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb22c4a-b857-4f19-9a33-07b4299eff75 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.433930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 410/804] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:52.439836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb22c4a-b857-4f19-9a33-07b4299eff75 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.449148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc6a6-3631-47e5-b6f5-e523219868b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.450582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc6a6-3631-47e5-b6f5-e523219868b7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.451064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc6a6-3631-47e5-b6f5-e523219868b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.452237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc6a6-3631-47e5-b6f5-e523219868b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.468830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fc6a6-3631-47e5-b6f5-e523219868b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6a1fc6a6-3631-47e5-b6f5-e523219868b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:52.477694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:52.478672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:52.479516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:52.482315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 395/805] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:52.487788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc6a6-3631-47e5-b6f5-e523219868b7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.505054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.575044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb22c4a-b857-4f19-9a33-07b4299eff75 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.607895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc6a6-3631-47e5-b6f5-e523219868b7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.623407 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c627dc8-b711-4051-aafc-53fc71ee9fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.624514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c627dc8-b711-4051-aafc-53fc71ee9fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.625059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c627dc8-b711-4051-aafc-53fc71ee9fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.625340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c627dc8-b711-4051-aafc-53fc71ee9fa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.640591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c627dc8-b711-4051-aafc-53fc71ee9fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.642690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c627dc8-b711-4051-aafc-53fc71ee9fa8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.649548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18cf55-99c6-4616-8d2b-099360772816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.650165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18cf55-99c6-4616-8d2b-099360772816 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.650504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18cf55-99c6-4616-8d2b-099360772816 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.650781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18cf55-99c6-4616-8d2b-099360772816 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.651454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18cf55-99c6-4616-8d2b-099360772816 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:52.651800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18cf55-99c6-4616-8d2b-099360772816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.653287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18cf55-99c6-4616-8d2b-099360772816 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7c627dc8-b711-4051-aafc-53fc71ee9fa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:52.661935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:52.662932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:52.664447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:52.664447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:52.664447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:52.664447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 411/807] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:52.664704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 396/807] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:52.668938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c627dc8-b711-4051-aafc-53fc71ee9fa8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.669062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18cf55-99c6-4616-8d2b-099360772816 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.682559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.819093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18cf55-99c6-4616-8d2b-099360772816 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.820597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:52.835712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c627dc8-b711-4051-aafc-53fc71ee9fa8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:52.862738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff696e-6c22-46cf-9b8e-172723557fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.863272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff696e-6c22-46cf-9b8e-172723557fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.863553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff696e-6c22-46cf-9b8e-172723557fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.863828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff696e-6c22-46cf-9b8e-172723557fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.864481 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff696e-6c22-46cf-9b8e-172723557fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:52.864782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff696e-6c22-46cf-9b8e-172723557fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.866178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff696e-6c22-46cf-9b8e-172723557fc7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.883084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 397/808] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:52.884357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401df73-6c2a-4fd3-8db8-899a759d09f8 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.884646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401df73-6c2a-4fd3-8db8-899a759d09f8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.884908 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401df73-6c2a-4fd3-8db8-899a759d09f8 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.886150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ac56-a110-4771-8703-03e3945c58f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:52.890714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 398/809] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:52.890714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401df73-6c2a-4fd3-8db8-899a759d09f8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:52.890874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ac56-a110-4771-8703-03e3945c58f9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.890874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ac56-a110-4771-8703-03e3945c58f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.890874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ac56-a110-4771-8703-03e3945c58f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.907209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ac56-a110-4771-8703-03e3945c58f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:52.910341 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ac56-a110-4771-8703-03e3945c58f9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-42f7ac56-a110-4771-8703-03e3945c58f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:52.928673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:52.929722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:52.930637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:52.930637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:52.930637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:52.930637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 412/810] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:52.931732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303caf6-c0f1-4064-9e56-072ec9b4a505 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:52.932012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303caf6-c0f1-4064-9e56-072ec9b4a505 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:52.932281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303caf6-c0f1-4064-9e56-072ec9b4a505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:52.950516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d303caf6-c0f1-4064-9e56-072ec9b4a505 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:52.951708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d303caf6-c0f1-4064-9e56-072ec9b4a505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:52.977213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.010514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401df73-6c2a-4fd3-8db8-899a759d09f8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.025164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 413/811] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:44:53.026269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc7b75-4ee6-46ee-92b0-bebcbfbace94 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.026555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc7b75-4ee6-46ee-92b0-bebcbfbace94 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.026826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc7b75-4ee6-46ee-92b0-bebcbfbace94 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.032188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 414/812] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:53.032188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc7b75-4ee6-46ee-92b0-bebcbfbace94 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.059378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9a915-d22e-4a03-b6a1-6130e4681523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.060155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9a915-d22e-4a03-b6a1-6130e4681523 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.060543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9a915-d22e-4a03-b6a1-6130e4681523 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.060884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9a915-d22e-4a03-b6a1-6130e4681523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.069679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9a915-d22e-4a03-b6a1-6130e4681523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.071152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9a915-d22e-4a03-b6a1-6130e4681523 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7ba9a915-d22e-4a03-b6a1-6130e4681523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:53.083881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:53.084831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:53.085749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:53.085749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:53.085749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:53.085749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:53.085749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:53.085749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:53.085749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:53.085749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:53.090077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 399/813] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:53.091540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61210ad-d26c-465f-82ec-eac2a8124211 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.091905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61210ad-d26c-465f-82ec-eac2a8124211 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.092249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61210ad-d26c-465f-82ec-eac2a8124211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.112995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c61210ad-d26c-465f-82ec-eac2a8124211 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:53.114385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c61210ad-d26c-465f-82ec-eac2a8124211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:53.131128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.161857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc7b75-4ee6-46ee-92b0-bebcbfbace94 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.198464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f4107-740d-4b74-a32a-2d72942bef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.199474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f4107-740d-4b74-a32a-2d72942bef74 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.199993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f4107-740d-4b74-a32a-2d72942bef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.200521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f4107-740d-4b74-a32a-2d72942bef74 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.201417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f4107-740d-4b74-a32a-2d72942bef74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:53.201977 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f4107-740d-4b74-a32a-2d72942bef74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.203599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f4107-740d-4b74-a32a-2d72942bef74 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.205817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 400/814] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:44:53.206951 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61210ad-d26c-465f-82ec-eac2a8124211 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.221583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 415/815] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:53.223988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f4107-740d-4b74-a32a-2d72942bef74 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.323862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.373781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f4107-740d-4b74-a32a-2d72942bef74 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.378658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61210ad-d26c-465f-82ec-eac2a8124211 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.419981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47718f62-86e2-4101-880c-2747aaff34f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.420917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47718f62-86e2-4101-880c-2747aaff34f3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.421043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7545-0fbf-4bc8-80ca-246b07e59c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.421484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47718f62-86e2-4101-880c-2747aaff34f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.421598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7545-0fbf-4bc8-80ca-246b07e59c1e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.421826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7545-0fbf-4bc8-80ca-246b07e59c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.422095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7545-0fbf-4bc8-80ca-246b07e59c1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.422393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47718f62-86e2-4101-880c-2747aaff34f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.423289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47718f62-86e2-4101-880c-2747aaff34f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:53.423970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.424141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47718f62-86e2-4101-880c-2747aaff34f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.425824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47718f62-86e2-4101-880c-2747aaff34f3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.431443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b7545-0fbf-4bc8-80ca-246b07e59c1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.432868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b7545-0fbf-4bc8-80ca-246b07e59c1e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.438919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 401/816] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:53.440343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47718f62-86e2-4101-880c-2747aaff34f3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7f1b7545-0fbf-4bc8-80ca-246b07e59c1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:53.449258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:53.451859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 416/817] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:53.452992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7545-0fbf-4bc8-80ca-246b07e59c1e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.556144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47718f62-86e2-4101-880c-2747aaff34f3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.572866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7545-0fbf-4bc8-80ca-246b07e59c1e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.578087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.592929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a2c6-388d-4f8a-b86c-4450836763fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.593586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a2c6-388d-4f8a-b86c-4450836763fa None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.593860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a2c6-388d-4f8a-b86c-4450836763fa None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.595368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a2c6-388d-4f8a-b86c-4450836763fa None admin] PATH_INFO: `/v3/services/network` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.595368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107a2c6-388d-4f8a-b86c-4450836763fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.597250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107a2c6-388d-4f8a-b86c-4450836763fa None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f107a2c6-388d-4f8a-b86c-4450836763fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:53.606576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:53.607584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:53.608430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 402/818] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:53.609350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a2c6-388d-4f8a-b86c-4450836763fa None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.613568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4d735-cbdf-4f60-81c0-55bf123535f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.614225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4d735-cbdf-4f60-81c0-55bf123535f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.614497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4d735-cbdf-4f60-81c0-55bf123535f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.615556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4d735-cbdf-4f60-81c0-55bf123535f0 None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/f362b8daae13435a9a468b06c4998c67/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.616701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4d735-cbdf-4f60-81c0-55bf123535f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=f362b8daae13435a9a468b06c4998c67, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.618333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4d735-cbdf-4f60-81c0-55bf123535f0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.705514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 417/819] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:53 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/f362b8daae13435a9a468b06c4998c67/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:53.705514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4d735-cbdf-4f60-81c0-55bf123535f0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.727978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a2c6-388d-4f8a-b86c-4450836763fa None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.770925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff94e8-c907-4e23-a83b-df38c9794b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.771885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff94e8-c907-4e23-a83b-df38c9794b84 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.772413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff94e8-c907-4e23-a83b-df38c9794b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.772915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff94e8-c907-4e23-a83b-df38c9794b84 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.773927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff94e8-c907-4e23-a83b-df38c9794b84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:53.774502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff94e8-c907-4e23-a83b-df38c9794b84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.776303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff94e8-c907-4e23-a83b-df38c9794b84 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.784744 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.801860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 403/820] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:53.803208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff94e8-c907-4e23-a83b-df38c9794b84 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.849806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4d735-cbdf-4f60-81c0-55bf123535f0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.857223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:53.897067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb19b9-bd92-447a-bb17-eaa1cdf155a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.897742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb19b9-bd92-447a-bb17-eaa1cdf155a9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.897916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb19b9-bd92-447a-bb17-eaa1cdf155a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.898181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb19b9-bd92-447a-bb17-eaa1cdf155a9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.898763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb19b9-bd92-447a-bb17-eaa1cdf155a9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.900125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb19b9-bd92-447a-bb17-eaa1cdf155a9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7ffb19b9-bd92-447a-bb17-eaa1cdf155a9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:53.913860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:53.914875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:44:53.915706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:53.918121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 418/821] 10.222.0.58 () {56 vars in 1129 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:53.919316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb19b9-bd92-447a-bb17-eaa1cdf155a9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:53.944659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff94e8-c907-4e23-a83b-df38c9794b84 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:53.983251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5eb63a-053e-4aed-9820-606a286ec827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:53.984298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5eb63a-053e-4aed-9820-606a286ec827 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:53.984298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5eb63a-053e-4aed-9820-606a286ec827 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:53.984756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5eb63a-053e-4aed-9820-606a286ec827 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:53.985603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5eb63a-053e-4aed-9820-606a286ec827 None admin] RBAC: Adding query filter params (name=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:53.986019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5eb63a-053e-4aed-9820-606a286ec827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:53.987546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5eb63a-053e-4aed-9820-606a286ec827 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:53.992766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 404/822] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:53.997781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5eb63a-053e-4aed-9820-606a286ec827 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.118181 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5eb63a-053e-4aed-9820-606a286ec827 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.126673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.167058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb19b9-bd92-447a-bb17-eaa1cdf155a9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.168914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca5186-988e-40de-9b5b-44a7fda18d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.170235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca5186-988e-40de-9b5b-44a7fda18d52 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.170235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca5186-988e-40de-9b5b-44a7fda18d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.170413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca5186-988e-40de-9b5b-44a7fda18d52 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.171015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca5186-988e-40de-9b5b-44a7fda18d52 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:54.171312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca5186-988e-40de-9b5b-44a7fda18d52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.172721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca5186-988e-40de-9b5b-44a7fda18d52 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.178392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 405/823] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:54.179285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca5186-988e-40de-9b5b-44a7fda18d52 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.189755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.213455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0f2b-73bb-4560-b79a-3b04e8abb6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.214942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0f2b-73bb-4560-b79a-3b04e8abb6dc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.215609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0f2b-73bb-4560-b79a-3b04e8abb6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.216033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0f2b-73bb-4560-b79a-3b04e8abb6dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.229706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0f2b-73bb-4560-b79a-3b04e8abb6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.232166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0f2b-73bb-4560-b79a-3b04e8abb6dc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-dd4d0f2b-73bb-4560-b79a-3b04e8abb6dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:54.253699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:54.254869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:54.255989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:54.255989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:54.255989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:54.257949 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 419/824] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:54.258862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0f2b-73bb-4560-b79a-3b04e8abb6dc None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.299496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca5186-988e-40de-9b5b-44a7fda18d52 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.346867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec0fb-1e92-481e-9c0e-44a8a016ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.347719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec0fb-1e92-481e-9c0e-44a8a016ab8a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.348138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec0fb-1e92-481e-9c0e-44a8a016ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.348543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec0fb-1e92-481e-9c0e-44a8a016ab8a None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.349898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec0fb-1e92-481e-9c0e-44a8a016ab8a None admin] RBAC: Adding query filter params (type=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:54.350202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec0fb-1e92-481e-9c0e-44a8a016ab8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.351623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec0fb-1e92-481e-9c0e-44a8a016ab8a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.363821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 406/825] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:54.363821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec0fb-1e92-481e-9c0e-44a8a016ab8a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.383149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0f2b-73bb-4560-b79a-3b04e8abb6dc None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.407256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.421007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3e92c-5907-4fff-9400-891abf6fbe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.421930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3e92c-5907-4fff-9400-891abf6fbe5f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.422405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3e92c-5907-4fff-9400-891abf6fbe5f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.422905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3e92c-5907-4fff-9400-891abf6fbe5f None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.424346 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3e92c-5907-4fff-9400-891abf6fbe5f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:54.424951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3e92c-5907-4fff-9400-891abf6fbe5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.426581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3e92c-5907-4fff-9400-891abf6fbe5f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.436530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 420/826] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:54.437675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3e92c-5907-4fff-9400-891abf6fbe5f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.474917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.495515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec0fb-1e92-481e-9c0e-44a8a016ab8a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.538602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d5c2e-17a2-4a26-b514-164b1a0dbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.539210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d5c2e-17a2-4a26-b514-164b1a0dbf83 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.539484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d5c2e-17a2-4a26-b514-164b1a0dbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.539752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d5c2e-17a2-4a26-b514-164b1a0dbf83 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.540394 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d5c2e-17a2-4a26-b514-164b1a0dbf83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:54.540686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d5c2e-17a2-4a26-b514-164b1a0dbf83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.542067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d5c2e-17a2-4a26-b514-164b1a0dbf83 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.551417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3e92c-5907-4fff-9400-891abf6fbe5f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.553734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 407/827] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:54.554505 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d5c2e-17a2-4a26-b514-164b1a0dbf83 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.593996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd49b9-cb57-480f-80d0-2a24b73ef9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.594888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd49b9-cb57-480f-80d0-2a24b73ef9d6 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.595343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd49b9-cb57-480f-80d0-2a24b73ef9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.595813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd49b9-cb57-480f-80d0-2a24b73ef9d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.596467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd49b9-cb57-480f-80d0-2a24b73ef9d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.597956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd49b9-cb57-480f-80d0-2a24b73ef9d6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.648877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.655304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d5c2e-17a2-4a26-b514-164b1a0dbf83 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.692179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfef33a-c5c5-45a9-a0e8-d645e1897b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.692179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfef33a-c5c5-45a9-a0e8-d645e1897b74 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.692179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfef33a-c5c5-45a9-a0e8-d645e1897b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.692179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfef33a-c5c5-45a9-a0e8-d645e1897b74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.693147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfef33a-c5c5-45a9-a0e8-d645e1897b74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.693147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfef33a-c5c5-45a9-a0e8-d645e1897b74 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.727064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 421/828] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:44:54 2022] POST /identity/v3/endpoints => generated 337 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:54.728316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776982af-bff3-4bf5-8174-79b68d990658 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.728625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776982af-bff3-4bf5-8174-79b68d990658 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.728871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776982af-bff3-4bf5-8174-79b68d990658 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.733511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 422/829] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:54.733511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776982af-bff3-4bf5-8174-79b68d990658 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.826183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 408/830] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:44:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:54.827996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e05b5-6d6a-466f-9d7d-228f777416c5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.828355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e05b5-6d6a-466f-9d7d-228f777416c5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.828732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e05b5-6d6a-466f-9d7d-228f777416c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.846841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:54.866142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776982af-bff3-4bf5-8174-79b68d990658 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:54.870945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-291e05b5-6d6a-466f-9d7d-228f777416c5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:54.872555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-291e05b5-6d6a-466f-9d7d-228f777416c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:54.908836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb4c1f-17b9-480f-a7ef-3b95ff56795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:54.909593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb4c1f-17b9-480f-a7ef-3b95ff56795a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:54.909765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb4c1f-17b9-480f-a7ef-3b95ff56795a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:54.910280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb4c1f-17b9-480f-a7ef-3b95ff56795a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:54.922145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb4c1f-17b9-480f-a7ef-3b95ff56795a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:54.924984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb4c1f-17b9-480f-a7ef-3b95ff56795a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b4eb4c1f-17b9-480f-a7ef-3b95ff56795a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:54.943352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:54.944286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:54.945194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:54.945194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:54.945194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:54.945194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:54.945194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:54.945194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:54.945194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:54.945194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:54.946180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 423/831] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:54.952798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb4c1f-17b9-480f-a7ef-3b95ff56795a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:54.993097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 409/832] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:44:55.088072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb4c1f-17b9-480f-a7ef-3b95ff56795a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.123852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939f89c-348e-48be-83c9-b6b29bb07c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.124776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939f89c-348e-48be-83c9-b6b29bb07c82 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.125196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939f89c-348e-48be-83c9-b6b29bb07c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.125645 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939f89c-348e-48be-83c9-b6b29bb07c82 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.127003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939f89c-348e-48be-83c9-b6b29bb07c82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:55.127472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939f89c-348e-48be-83c9-b6b29bb07c82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.129039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939f89c-348e-48be-83c9-b6b29bb07c82 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.148135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 424/833] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:55.149755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e05b5-6d6a-466f-9d7d-228f777416c5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.238029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:55.256955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e05b5-6d6a-466f-9d7d-228f777416c5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.292623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec6795-4dfe-418b-9605-cfc1d8b84926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.293292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec6795-4dfe-418b-9605-cfc1d8b84926 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.293592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec6795-4dfe-418b-9605-cfc1d8b84926 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.293860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec6795-4dfe-418b-9605-cfc1d8b84926 None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/97a62895f65f4e6aaa23d2941ed43d79/roles/812d9626de92430d9cef17f80d5a1b4e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.310298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec6795-4dfe-418b-9605-cfc1d8b84926 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=97a62895f65f4e6aaa23d2941ed43d79, role_id=812d9626de92430d9cef17f80d5a1b4e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.311737 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec6795-4dfe-418b-9605-cfc1d8b84926 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.316629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939f89c-348e-48be-83c9-b6b29bb07c82 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.326420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:55.416147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 410/834] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:44:55 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/97a62895f65f4e6aaa23d2941ed43d79/roles/812d9626de92430d9cef17f80d5a1b4e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:44:55.431939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939f89c-348e-48be-83c9-b6b29bb07c82 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.473841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63d62a-9890-4cd5-83a3-63bcf899437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.474495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63d62a-9890-4cd5-83a3-63bcf899437c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.474769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63d62a-9890-4cd5-83a3-63bcf899437c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.475037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63d62a-9890-4cd5-83a3-63bcf899437c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.475750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63d62a-9890-4cd5-83a3-63bcf899437c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.477251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63d62a-9890-4cd5-83a3-63bcf899437c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-dd63d62a-9890-4cd5-83a3-63bcf899437c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:55.487914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:55.488998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:44:55.489930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:55.493627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 425/835] 10.222.0.58 () {56 vars in 1132 bytes} [Wed Aug 24 07:44:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:55.495775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec6795-4dfe-418b-9605-cfc1d8b84926 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.614507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec6795-4dfe-418b-9605-cfc1d8b84926 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.647282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:55.652982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba64f1-b1f2-4b06-be86-0546556e344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.653631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba64f1-b1f2-4b06-be86-0546556e344e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.653905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba64f1-b1f2-4b06-be86-0546556e344e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.654168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba64f1-b1f2-4b06-be86-0546556e344e None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.654787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba64f1-b1f2-4b06-be86-0546556e344e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:55.655081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba64f1-b1f2-4b06-be86-0546556e344e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.656419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba64f1-b1f2-4b06-be86-0546556e344e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.662240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 411/836] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:44:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:55.668198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63d62a-9890-4cd5-83a3-63bcf899437c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:55.685482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fb4f9-e8ae-42ee-8c1d-0f63425b903a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.686331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fb4f9-e8ae-42ee-8c1d-0f63425b903a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.687094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fb4f9-e8ae-42ee-8c1d-0f63425b903a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.690382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 412/837] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:55.696911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf284d1-9bc4-4256-950d-6a7f53793311 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.697197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf284d1-9bc4-4256-950d-6a7f53793311 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.697754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf284d1-9bc4-4256-950d-6a7f53793311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.720483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-baf284d1-9bc4-4256-950d-6a7f53793311 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:55.722106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-baf284d1-9bc4-4256-950d-6a7f53793311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:55.744687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:55.777037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63d62a-9890-4cd5-83a3-63bcf899437c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:55.806971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 413/838] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:44:55.817490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cec7d-923c-4b3e-8582-c74ee8d32913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:55.817490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cec7d-923c-4b3e-8582-c74ee8d32913 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:55.817490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cec7d-923c-4b3e-8582-c74ee8d32913 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:55.817490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cec7d-923c-4b3e-8582-c74ee8d32913 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:55.817865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cec7d-923c-4b3e-8582-c74ee8d32913 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:55.817865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cec7d-923c-4b3e-8582-c74ee8d32913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:55.819068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cec7d-923c-4b3e-8582-c74ee8d32913 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:55.824148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 426/839] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:44:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:56.080301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf284d1-9bc4-4256-950d-6a7f53793311 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.187876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf284d1-9bc4-4256-950d-6a7f53793311 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:56.212574 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:56.224560 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3448de-b9b2-4815-9c56-0fcb5551a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:56.225190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3448de-b9b2-4815-9c56-0fcb5551a046 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.225484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3448de-b9b2-4815-9c56-0fcb5551a046 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.225764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3448de-b9b2-4815-9c56-0fcb5551a046 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.236164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3448de-b9b2-4815-9c56-0fcb5551a046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ce3448de-b9b2-4815-9c56-0fcb5551a046 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:56.241798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:56.242746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:56.244203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 414/840] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:56.252716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cec7d-923c-4b3e-8582-c74ee8d32913 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.357672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cec7d-923c-4b3e-8582-c74ee8d32913 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:56.393711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2159f5-f452-4836-8a5d-8a2ee5e60a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:56.394357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2159f5-f452-4836-8a5d-8a2ee5e60a95 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.394635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2159f5-f452-4836-8a5d-8a2ee5e60a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.394898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2159f5-f452-4836-8a5d-8a2ee5e60a95 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.395747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2159f5-f452-4836-8a5d-8a2ee5e60a95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:56.395844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2159f5-f452-4836-8a5d-8a2ee5e60a95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:56.397281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2159f5-f452-4836-8a5d-8a2ee5e60a95 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:56.404418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:56.406606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 427/841] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:56.414542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3448de-b9b2-4815-9c56-0fcb5551a046 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.529581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3448de-b9b2-4815-9c56-0fcb5551a046 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:56.566297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace87a99-e200-4352-a59f-543b9a361523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:56.566930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87a99-e200-4352-a59f-543b9a361523 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.567206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87a99-e200-4352-a59f-543b9a361523 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.567474 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87a99-e200-4352-a59f-543b9a361523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.577882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace87a99-e200-4352-a59f-543b9a361523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:56.579932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace87a99-e200-4352-a59f-543b9a361523 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ace87a99-e200-4352-a59f-543b9a361523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:56.594948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:56.597043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:56.597964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:56.597964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:56.597964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:56.597964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 415/842] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:56.604514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2159f5-f452-4836-8a5d-8a2ee5e60a95 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.710002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2159f5-f452-4836-8a5d-8a2ee5e60a95 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:56.748362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e00f97-5e10-4dbe-a61a-3d16ecb55ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:56.748978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e00f97-5e10-4dbe-a61a-3d16ecb55ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.749244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e00f97-5e10-4dbe-a61a-3d16ecb55ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.749545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e00f97-5e10-4dbe-a61a-3d16ecb55ae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.750188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e00f97-5e10-4dbe-a61a-3d16ecb55ae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:56.750487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e00f97-5e10-4dbe-a61a-3d16ecb55ae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:56.752355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e00f97-5e10-4dbe-a61a-3d16ecb55ae7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:56.764308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 428/843] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:56.770547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace87a99-e200-4352-a59f-543b9a361523 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.811607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:56.877922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace87a99-e200-4352-a59f-543b9a361523 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:56.913578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc437632-d438-4a41-bf31-6210005dcfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:56.914227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437632-d438-4a41-bf31-6210005dcfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.914563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437632-d438-4a41-bf31-6210005dcfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.914829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc437632-d438-4a41-bf31-6210005dcfe8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.923969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437632-d438-4a41-bf31-6210005dcfe8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:56.925578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc437632-d438-4a41-bf31-6210005dcfe8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-bc437632-d438-4a41-bf31-6210005dcfe8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:56.938162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:56.939183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:56.940147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 416/844] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:56.946569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e00f97-5e10-4dbe-a61a-3d16ecb55ae7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:56.993142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ffce0-476b-419d-b704-c2467665cd0e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:56.993334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ffce0-476b-419d-b704-c2467665cd0e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:56.993637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ffce0-476b-419d-b704-c2467665cd0e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:56.996236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 417/845] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:44:57.000245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebab77a-e7c9-4830-8ac7-3fb8e3347247 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.000514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebab77a-e7c9-4830-8ac7-3fb8e3347247 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.000817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebab77a-e7c9-4830-8ac7-3fb8e3347247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.012523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.020800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-eebab77a-e7c9-4830-8ac7-3fb8e3347247 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:57.022022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-eebab77a-e7c9-4830-8ac7-3fb8e3347247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:57.063086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e00f97-5e10-4dbe-a61a-3d16ecb55ae7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.102447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75fad9-6789-4266-9b3a-e845e639b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.103543 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75fad9-6789-4266-9b3a-e845e639b468 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.104021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75fad9-6789-4266-9b3a-e845e639b468 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.104389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 418/846] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:44:57.104708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75fad9-6789-4266-9b3a-e845e639b468 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.105933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75fad9-6789-4266-9b3a-e845e639b468 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:57.106439 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75fad9-6789-4266-9b3a-e845e639b468 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.108061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75fad9-6789-4266-9b3a-e845e639b468 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.130991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 429/847] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 07:44:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:57.136925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebab77a-e7c9-4830-8ac7-3fb8e3347247 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.166218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.243815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebab77a-e7c9-4830-8ac7-3fb8e3347247 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.280383 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9c51f-6344-4208-8ca9-7cad06f46880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.281495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9c51f-6344-4208-8ca9-7cad06f46880 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.282010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9c51f-6344-4208-8ca9-7cad06f46880 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.283237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9c51f-6344-4208-8ca9-7cad06f46880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.373810 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75fad9-6789-4266-9b3a-e845e639b468 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.375057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9c51f-6344-4208-8ca9-7cad06f46880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.377366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9c51f-6344-4208-8ca9-7cad06f46880 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.404982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.491522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 419/848] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:57.497749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9c51f-6344-4208-8ca9-7cad06f46880 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.499956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75fad9-6789-4266-9b3a-e845e639b468 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.518755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.540543 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b747b-4607-4339-93fa-a57f6faf7ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.541502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b747b-4607-4339-93fa-a57f6faf7ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.541982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b747b-4607-4339-93fa-a57f6faf7ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.542418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b747b-4607-4339-93fa-a57f6faf7ad2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.543172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b747b-4607-4339-93fa-a57f6faf7ad2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.544698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b747b-4607-4339-93fa-a57f6faf7ad2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-122b747b-4607-4339-93fa-a57f6faf7ad2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:57.556774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:57.557803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:44:57.558644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:57.560571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 430/849] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:44:57.561871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503fc57-0655-4eaa-88d9-7476710ff33d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.562296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503fc57-0655-4eaa-88d9-7476710ff33d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.562699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503fc57-0655-4eaa-88d9-7476710ff33d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.564455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 431/850] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:57.567897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503fc57-0655-4eaa-88d9-7476710ff33d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.607498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9c51f-6344-4208-8ca9-7cad06f46880 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.642262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.652803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743ff74-540a-477e-b561-a5de54d5edb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.653712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743ff74-540a-477e-b561-a5de54d5edb5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.653989 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743ff74-540a-477e-b561-a5de54d5edb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.654252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743ff74-540a-477e-b561-a5de54d5edb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.667786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743ff74-540a-477e-b561-a5de54d5edb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.669215 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743ff74-540a-477e-b561-a5de54d5edb5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.676442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503fc57-0655-4eaa-88d9-7476710ff33d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0743ff74-540a-477e-b561-a5de54d5edb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:57.684722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:57.685744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:57.686750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:57.686750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:57.686750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:57.686750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 420/851] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:57.687795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b10cd-04d2-4331-9ab2-eeb6d146efe6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.687795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b10cd-04d2-4331-9ab2-eeb6d146efe6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.687795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b10cd-04d2-4331-9ab2-eeb6d146efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.705414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ce4b10cd-04d2-4331-9ab2-eeb6d146efe6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:57.706691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ce4b10cd-04d2-4331-9ab2-eeb6d146efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:57.718135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52b0c-b70a-43ec-816a-b0c69fc1e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.718900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52b0c-b70a-43ec-816a-b0c69fc1e54f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.719178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52b0c-b70a-43ec-816a-b0c69fc1e54f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.719446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52b0c-b70a-43ec-816a-b0c69fc1e54f None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.720901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52b0c-b70a-43ec-816a-b0c69fc1e54f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:57.721207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52b0c-b70a-43ec-816a-b0c69fc1e54f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.722611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52b0c-b70a-43ec-816a-b0c69fc1e54f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.727341 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 432/852] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:57.728130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52b0c-b70a-43ec-816a-b0c69fc1e54f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.775862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.789938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 421/853] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:44:57.789938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b10cd-04d2-4331-9ab2-eeb6d146efe6 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.847317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52b0c-b70a-43ec-816a-b0c69fc1e54f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.884465 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17c46a-6465-4eaf-a977-11bc5d9989de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.885087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c46a-6465-4eaf-a977-11bc5d9989de None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.885365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c46a-6465-4eaf-a977-11bc5d9989de None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.885701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17c46a-6465-4eaf-a977-11bc5d9989de None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.886342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17c46a-6465-4eaf-a977-11bc5d9989de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:57.886654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17c46a-6465-4eaf-a977-11bc5d9989de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.888023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17c46a-6465-4eaf-a977-11bc5d9989de None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.901086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 433/854] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:57.902380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249998a-5deb-44e9-8003-59641da7b08e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.902665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249998a-5deb-44e9-8003-59641da7b08e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.902938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249998a-5deb-44e9-8003-59641da7b08e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.908857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 434/855] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:57.908857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249998a-5deb-44e9-8003-59641da7b08e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:57.911774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b10cd-04d2-4331-9ab2-eeb6d146efe6 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:57.922472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:57.949388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d3c62-d566-45de-b735-1d5792f2b24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:57.950322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3c62-d566-45de-b735-1d5792f2b24d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.950779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3c62-d566-45de-b735-1d5792f2b24d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.951195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3c62-d566-45de-b735-1d5792f2b24d None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.952452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3c62-d566-45de-b735-1d5792f2b24d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:57.952904 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3c62-d566-45de-b735-1d5792f2b24d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:57.956035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d3c62-d566-45de-b735-1d5792f2b24d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:57.969514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 422/856] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:57.969514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58540d3e-b083-42b8-b7cb-772bd165ce5d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:57.969514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58540d3e-b083-42b8-b7cb-772bd165ce5d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:57.969514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58540d3e-b083-42b8-b7cb-772bd165ce5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:57.998557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-58540d3e-b083-42b8-b7cb-772bd165ce5d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:57.999878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-58540d3e-b083-42b8-b7cb-772bd165ce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:58.041781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249998a-5deb-44e9-8003-59641da7b08e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.044631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.087662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63252459-7acc-4908-b7ed-30d2e470b954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.088443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63252459-7acc-4908-b7ed-30d2e470b954 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.088942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63252459-7acc-4908-b7ed-30d2e470b954 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.089166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63252459-7acc-4908-b7ed-30d2e470b954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.093956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 423/857] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:44:58.094686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58540d3e-b083-42b8-b7cb-772bd165ce5d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.107761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63252459-7acc-4908-b7ed-30d2e470b954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.109191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63252459-7acc-4908-b7ed-30d2e470b954 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-63252459-7acc-4908-b7ed-30d2e470b954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:44:58.123865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:58.124829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:58.126716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:44:58.126716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:44:58.126716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:44:58.126716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:44:58.126716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:44:58.126716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:44:58.126716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:44:58.126716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:58.126716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 435/858] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:58.132183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63252459-7acc-4908-b7ed-30d2e470b954 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.228324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58540d3e-b083-42b8-b7cb-772bd165ce5d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.230033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.267038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63252459-7acc-4908-b7ed-30d2e470b954 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.275090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9785163-8504-44c5-b4cc-3256ad62883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.275955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9785163-8504-44c5-b4cc-3256ad62883c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.276397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9785163-8504-44c5-b4cc-3256ad62883c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.276814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9785163-8504-44c5-b4cc-3256ad62883c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.291920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9785163-8504-44c5-b4cc-3256ad62883c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a9785163-8504-44c5-b4cc-3256ad62883c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:44:58.298886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:58.305243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:58.306182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 424/859] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:58.307276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9785163-8504-44c5-b4cc-3256ad62883c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.324137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabbddc-c49f-4d29-9e15-05038f00ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.324754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabbddc-c49f-4d29-9e15-05038f00ca21 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.325027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabbddc-c49f-4d29-9e15-05038f00ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.325293 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabbddc-c49f-4d29-9e15-05038f00ca21 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.326028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabbddc-c49f-4d29-9e15-05038f00ca21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:58.326328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabbddc-c49f-4d29-9e15-05038f00ca21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.328361 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabbddc-c49f-4d29-9e15-05038f00ca21 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.341403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 436/860] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:44:58.349223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabbddc-c49f-4d29-9e15-05038f00ca21 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.381441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.437257 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9785163-8504-44c5-b4cc-3256ad62883c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.462234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabbddc-c49f-4d29-9e15-05038f00ca21 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.474689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5091cf-cafd-47f1-b3b6-bf6a072fb7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.475338 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5091cf-cafd-47f1-b3b6-bf6a072fb7fd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.475610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5091cf-cafd-47f1-b3b6-bf6a072fb7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.475882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5091cf-cafd-47f1-b3b6-bf6a072fb7fd None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.476535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5091cf-cafd-47f1-b3b6-bf6a072fb7fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:58.476830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5091cf-cafd-47f1-b3b6-bf6a072fb7fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.478205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5091cf-cafd-47f1-b3b6-bf6a072fb7fd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.491398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 425/861] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:58.491398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5091cf-cafd-47f1-b3b6-bf6a072fb7fd None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.507297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e9025-3f7e-4103-a88d-3c7968fafdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.508383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9025-3f7e-4103-a88d-3c7968fafdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.509180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9025-3f7e-4103-a88d-3c7968fafdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.509672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9025-3f7e-4103-a88d-3c7968fafdf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.510608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e9025-3f7e-4103-a88d-3c7968fafdf2 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=f362b8daae13435a9a468b06c4998c67) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:58.511105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e9025-3f7e-4103-a88d-3c7968fafdf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.514306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e9025-3f7e-4103-a88d-3c7968fafdf2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.515606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.525787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 437/862] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/role_assignments?user.id=f362b8daae13435a9a468b06c4998c67&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:58.526965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e9025-3f7e-4103-a88d-3c7968fafdf2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.614137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5091cf-cafd-47f1-b3b6-bf6a072fb7fd None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.660356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca135d2d-6931-44b9-bad5-e662164de5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.661298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135d2d-6931-44b9-bad5-e662164de5ae None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.662270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135d2d-6931-44b9-bad5-e662164de5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.662748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135d2d-6931-44b9-bad5-e662164de5ae None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.664035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca135d2d-6931-44b9-bad5-e662164de5ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.666227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca135d2d-6931-44b9-bad5-e662164de5ae None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.671222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.687781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e9025-3f7e-4103-a88d-3c7968fafdf2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.728280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00665-0ad1-4f36-a47b-428fba25e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.728511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00665-0ad1-4f36-a47b-428fba25e84f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.728736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00665-0ad1-4f36-a47b-428fba25e84f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.728910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00665-0ad1-4f36-a47b-428fba25e84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.730632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 426/863] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:44:58 2022] POST /identity/v3/services => generated 269 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:44:58.743582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec00665-0ad1-4f36-a47b-428fba25e84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.745057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec00665-0ad1-4f36-a47b-428fba25e84f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-eec00665-0ad1-4f36-a47b-428fba25e84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:58.761918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:58.762959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:58.763853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:58.763853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:58.763853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:58.763853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 438/864] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:58.769838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca135d2d-6931-44b9-bad5-e662164de5ae None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:58.874396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.892214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca135d2d-6931-44b9-bad5-e662164de5ae None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:58.931304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02029c-e794-448a-a3db-52f4796315ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:58.931910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02029c-e794-448a-a3db-52f4796315ef None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:58.932183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02029c-e794-448a-a3db-52f4796315ef None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:58.932449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02029c-e794-448a-a3db-52f4796315ef None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:58.933086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02029c-e794-448a-a3db-52f4796315ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:58.933379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02029c-e794-448a-a3db-52f4796315ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:58.934764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02029c-e794-448a-a3db-52f4796315ef None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:58.947161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 427/865] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:58.952430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00665-0ad1-4f36-a47b-428fba25e84f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.063946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00665-0ad1-4f36-a47b-428fba25e84f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.098913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf48a0-4b8f-4b07-b58e-d6369070c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.099561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf48a0-4b8f-4b07-b58e-d6369070c530 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.099841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf48a0-4b8f-4b07-b58e-d6369070c530 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.100109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf48a0-4b8f-4b07-b58e-d6369070c530 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.110057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf48a0-4b8f-4b07-b58e-d6369070c530 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.112174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf48a0-4b8f-4b07-b58e-d6369070c530 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.114351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f6cf48a0-4b8f-4b07-b58e-d6369070c530 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:44:59.124739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:59.125712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:44:59.126913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 439/866] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:44:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:59.133700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02029c-e794-448a-a3db-52f4796315ef None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.244063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02029c-e794-448a-a3db-52f4796315ef None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.281580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989869e-a160-4939-891f-ce237bcd279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.282757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989869e-a160-4939-891f-ce237bcd279e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.283202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989869e-a160-4939-891f-ce237bcd279e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.283700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989869e-a160-4939-891f-ce237bcd279e None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.284499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989869e-a160-4939-891f-ce237bcd279e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:59.284804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989869e-a160-4939-891f-ce237bcd279e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.286559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989869e-a160-4939-891f-ce237bcd279e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.299563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.309135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 428/867] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:44:59.315185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf48a0-4b8f-4b07-b58e-d6369070c530 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.421383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf48a0-4b8f-4b07-b58e-d6369070c530 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.455361 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413b5c-59e4-484a-8c24-408797a8a016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.455960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413b5c-59e4-484a-8c24-408797a8a016 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.456229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413b5c-59e4-484a-8c24-408797a8a016 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.456494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413b5c-59e4-484a-8c24-408797a8a016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.522934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.526566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b413b5c-59e4-484a-8c24-408797a8a016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.528045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b413b5c-59e4-484a-8c24-408797a8a016 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.639203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 440/868] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:44:59.645274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989869e-a160-4939-891f-ce237bcd279e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.751933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989869e-a160-4939-891f-ce237bcd279e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.791401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f08de3-607e-4f59-802d-3125fb1d664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.792449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08de3-607e-4f59-802d-3125fb1d664b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.792929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08de3-607e-4f59-802d-3125fb1d664b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.793439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08de3-607e-4f59-802d-3125fb1d664b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.804877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f08de3-607e-4f59-802d-3125fb1d664b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.806669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f08de3-607e-4f59-802d-3125fb1d664b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-16f08de3-607e-4f59-802d-3125fb1d664b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:44:59.822216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:44:59.823220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:44:59.824127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:44:59.824127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:44:59.824127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:44:59.826192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 429/869] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:44:59.832004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413b5c-59e4-484a-8c24-408797a8a016 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:44:59.936939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:59.943053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413b5c-59e4-484a-8c24-408797a8a016 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:44:59.961057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22958a4-6c12-49d5-8224-7a8d1150cb86 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.961654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22958a4-6c12-49d5-8224-7a8d1150cb86 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.962093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22958a4-6c12-49d5-8224-7a8d1150cb86 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.964727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 430/870] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:44:59.971237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799dd7-6dd6-4f32-8a0c-ba9f377b3a47 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.971754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799dd7-6dd6-4f32-8a0c-ba9f377b3a47 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.972266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799dd7-6dd6-4f32-8a0c-ba9f377b3a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.981598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110bb7e-eba2-4bca-955b-8ec848b4914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:44:59.982253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110bb7e-eba2-4bca-955b-8ec848b4914f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:44:59.982526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110bb7e-eba2-4bca-955b-8ec848b4914f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:44:59.982790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110bb7e-eba2-4bca-955b-8ec848b4914f None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:44:59.983424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110bb7e-eba2-4bca-955b-8ec848b4914f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:44:59.983722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110bb7e-eba2-4bca-955b-8ec848b4914f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:44:59.985071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110bb7e-eba2-4bca-955b-8ec848b4914f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:44:59.993751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-74799dd7-6dd6-4f32-8a0c-ba9f377b3a47 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:44:59.995346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-74799dd7-6dd6-4f32-8a0c-ba9f377b3a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:44:59.997506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 441/871] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:00.003994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110bb7e-eba2-4bca-955b-8ec848b4914f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:00.061821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:00.091213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 431/872] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:44:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:00.119168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110bb7e-eba2-4bca-955b-8ec848b4914f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:00.154014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cb137-6094-479a-a7cc-75ebc5fb1701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:00.154967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cb137-6094-479a-a7cc-75ebc5fb1701 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:00.155445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cb137-6094-479a-a7cc-75ebc5fb1701 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:00.155886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cb137-6094-479a-a7cc-75ebc5fb1701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:00.163918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cb137-6094-479a-a7cc-75ebc5fb1701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:00.165630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cb137-6094-479a-a7cc-75ebc5fb1701 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ba8cb137-6094-479a-a7cc-75ebc5fb1701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:00.177182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:00.178141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:00.179030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:00.179030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:00.179030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:00.179030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:00.179030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:00.179030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:00.179030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:00.179030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:00.181082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 442/873] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:00.193750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74799dd7-6dd6-4f32-8a0c-ba9f377b3a47 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:00.295839 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74799dd7-6dd6-4f32-8a0c-ba9f377b3a47 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:00.332587 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45495a-233b-4cb9-9cd2-65d9fa55a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:00.333599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45495a-233b-4cb9-9cd2-65d9fa55a00f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:00.334074 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45495a-233b-4cb9-9cd2-65d9fa55a00f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:00.334559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45495a-233b-4cb9-9cd2-65d9fa55a00f None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:00.335454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45495a-233b-4cb9-9cd2-65d9fa55a00f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:00.335958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45495a-233b-4cb9-9cd2-65d9fa55a00f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:00.337597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45495a-233b-4cb9-9cd2-65d9fa55a00f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:00.351219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 432/874] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:00.358786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cb137-6094-479a-a7cc-75ebc5fb1701 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:00.378850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45495a-233b-4cb9-9cd2-65d9fa55a00f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:00.385545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:00.438641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:00.474440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cb137-6094-479a-a7cc-75ebc5fb1701 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:00.508442 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45495a-233b-4cb9-9cd2-65d9fa55a00f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:00.515445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ee65a-343a-4f68-9d0e-8e750f54d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:00.516052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee65a-343a-4f68-9d0e-8e750f54d160 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:00.516323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee65a-343a-4f68-9d0e-8e750f54d160 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:00.516772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee65a-343a-4f68-9d0e-8e750f54d160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:00.518113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ee65a-343a-4f68-9d0e-8e750f54d160 None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=97a62895f65f4e6aaa23d2941ed43d79) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:00.518446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ee65a-343a-4f68-9d0e-8e750f54d160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:00.519875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ee65a-343a-4f68-9d0e-8e750f54d160 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:00.533431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 443/875] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:00 2022] GET /identity/v3/role_assignments?user.id=97a62895f65f4e6aaa23d2941ed43d79&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:00.552345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91db418-66c7-4508-8f8a-b4ba797be862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:00.552983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91db418-66c7-4508-8f8a-b4ba797be862 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:00.553260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91db418-66c7-4508-8f8a-b4ba797be862 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:00.553556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91db418-66c7-4508-8f8a-b4ba797be862 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:00.554228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91db418-66c7-4508-8f8a-b4ba797be862 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:00.555720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91db418-66c7-4508-8f8a-b4ba797be862 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:00.666156 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 433/876] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:00 2022] POST /identity/v3/services => generated 251 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:00.675799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa054-eaaa-42ae-adec-48b84235eec7 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:00.676115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa054-eaaa-42ae-adec-48b84235eec7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:00.676351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa054-eaaa-42ae-adec-48b84235eec7 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:00.678237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 444/877] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:00.684499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34aa2a-361f-4f15-908d-b3b297bf7bcb None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:00.685038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34aa2a-361f-4f15-908d-b3b297bf7bcb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:00.685315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34aa2a-361f-4f15-908d-b3b297bf7bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:00.707572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-eb34aa2a-361f-4f15-908d-b3b297bf7bcb None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:00.708794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-eb34aa2a-361f-4f15-908d-b3b297bf7bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:00.793614 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 434/878] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:00.795387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3645-2d7a-4112-93d6-f5c9ed687900 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:00.795729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3645-2d7a-4112-93d6-f5c9ed687900 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:00.796170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3645-2d7a-4112-93d6-f5c9ed687900 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:00.798095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 445/879] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:00.804239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3f06-937f-4a72-9d8f-cf25b6212677 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:00.804527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3f06-937f-4a72-9d8f-cf25b6212677 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:00.804726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3f06-937f-4a72-9d8f-cf25b6212677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:00.824321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a22a3f06-937f-4a72-9d8f-cf25b6212677 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:00.825570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a22a3f06-937f-4a72-9d8f-cf25b6212677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:00.849641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:00.899121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 435/880] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:01.082170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3645-2d7a-4112-93d6-f5c9ed687900 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:01.167779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:01.172133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a3f06-937f-4a72-9d8f-cf25b6212677 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:01.196640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3645-2d7a-4112-93d6-f5c9ed687900 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:01.243277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b808-082b-4c30-ae85-013520e23e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:01.244441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b808-082b-4c30-ae85-013520e23e99 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:01.244879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b808-082b-4c30-ae85-013520e23e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:01.245573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b808-082b-4c30-ae85-013520e23e99 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:01.246706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0b808-082b-4c30-ae85-013520e23e99 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:01.248474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0b808-082b-4c30-ae85-013520e23e99 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-6bb0b808-082b-4c30-ae85-013520e23e99 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:01.260966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:01.262249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:01.263313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:01.266232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 446/881] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:01.273799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b808-082b-4c30-ae85-013520e23e99 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:01.298188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a3f06-937f-4a72-9d8f-cf25b6212677 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:01.349713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd133fa2-55a8-40a9-82d5-a3c607ba4198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:01.349713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd133fa2-55a8-40a9-82d5-a3c607ba4198 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:01.349713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd133fa2-55a8-40a9-82d5-a3c607ba4198 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:01.349713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd133fa2-55a8-40a9-82d5-a3c607ba4198 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:01.350120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd133fa2-55a8-40a9-82d5-a3c607ba4198 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:01.350437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd133fa2-55a8-40a9-82d5-a3c607ba4198 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-fd133fa2-55a8-40a9-82d5-a3c607ba4198 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:01.368143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:01.369111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:01.370051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 436/882] 10.222.0.58 () {56 vars in 1132 bytes} [Wed Aug 24 07:45:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:01.375549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd133fa2-55a8-40a9-82d5-a3c607ba4198 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:01.400523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:01.414184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b808-082b-4c30-ae85-013520e23e99 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:01.459457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e01498-9fa7-4ed4-bcbb-3c68bce809f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:01.460051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01498-9fa7-4ed4-bcbb-3c68bce809f7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:01.460318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01498-9fa7-4ed4-bcbb-3c68bce809f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:01.460584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e01498-9fa7-4ed4-bcbb-3c68bce809f7 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:01.461199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e01498-9fa7-4ed4-bcbb-3c68bce809f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:01.461522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e01498-9fa7-4ed4-bcbb-3c68bce809f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:01.462877 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e01498-9fa7-4ed4-bcbb-3c68bce809f7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:01.467882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 447/883] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:01.473497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e01498-9fa7-4ed4-bcbb-3c68bce809f7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:01.487497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:01.509502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd133fa2-55a8-40a9-82d5-a3c607ba4198 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:01.555030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee96ce5-25a8-47a2-9f3c-a45663d38a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:01.556356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96ce5-25a8-47a2-9f3c-a45663d38a08 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:01.556790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96ce5-25a8-47a2-9f3c-a45663d38a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:01.557235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96ce5-25a8-47a2-9f3c-a45663d38a08 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:01.558037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee96ce5-25a8-47a2-9f3c-a45663d38a08 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:01.558928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee96ce5-25a8-47a2-9f3c-a45663d38a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:01.560984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee96ce5-25a8-47a2-9f3c-a45663d38a08 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:01.569544 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 437/884] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:01.574208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee96ce5-25a8-47a2-9f3c-a45663d38a08 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:01.591569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e01498-9fa7-4ed4-bcbb-3c68bce809f7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:01.642102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672aaef-d325-4b69-9f5e-807f614d453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:01.642658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672aaef-d325-4b69-9f5e-807f614d453b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:01.642920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672aaef-d325-4b69-9f5e-807f614d453b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:01.643191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672aaef-d325-4b69-9f5e-807f614d453b None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:01.643817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672aaef-d325-4b69-9f5e-807f614d453b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:01.644114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672aaef-d325-4b69-9f5e-807f614d453b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:01.645488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672aaef-d325-4b69-9f5e-807f614d453b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:01.661497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 448/885] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:01.680442 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:01.698317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee96ce5-25a8-47a2-9f3c-a45663d38a08 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:01.740203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918623d-a68c-4540-9058-8591ea7f4a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:01.741281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918623d-a68c-4540-9058-8591ea7f4a48 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:01.741873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918623d-a68c-4540-9058-8591ea7f4a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:01.742359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918623d-a68c-4540-9058-8591ea7f4a48 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:01.743332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918623d-a68c-4540-9058-8591ea7f4a48 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:01.744133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918623d-a68c-4540-9058-8591ea7f4a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:01.747032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918623d-a68c-4540-9058-8591ea7f4a48 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:01.755787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 438/886] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:01.762355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672aaef-d325-4b69-9f5e-807f614d453b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:01.850964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:01.878833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672aaef-d325-4b69-9f5e-807f614d453b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:01.917496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee417601-1853-45de-b06d-17f83e8c1b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:01.918066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417601-1853-45de-b06d-17f83e8c1b62 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:01.918343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417601-1853-45de-b06d-17f83e8c1b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:01.918615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417601-1853-45de-b06d-17f83e8c1b62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:01.919321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee417601-1853-45de-b06d-17f83e8c1b62 None admin] RBAC: Adding query filter params (interface=public, service_id=ecc48db36a094235983e33192e884825, region_id=RegionOne) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:01.919625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee417601-1853-45de-b06d-17f83e8c1b62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:01.920984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee417601-1853-45de-b06d-17f83e8c1b62 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:01.927231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 449/887] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:01 2022] GET /identity/v3/endpoints?service_id=ecc48db36a094235983e33192e884825&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:01.932617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918623d-a68c-4540-9058-8591ea7f4a48 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:02.039628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918623d-a68c-4540-9058-8591ea7f4a48 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:02.075652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b82e99-1d38-4823-affb-12b10b466630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:02.076263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b82e99-1d38-4823-affb-12b10b466630 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.076537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b82e99-1d38-4823-affb-12b10b466630 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.076811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b82e99-1d38-4823-affb-12b10b466630 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.077412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b82e99-1d38-4823-affb-12b10b466630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:02.078797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b82e99-1d38-4823-affb-12b10b466630 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:02.085429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 439/888] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:01 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:45:02.609707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f944db5-285b-4d23-8763-bf7319006f87 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.610249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f944db5-285b-4d23-8763-bf7319006f87 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.610354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f944db5-285b-4d23-8763-bf7319006f87 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.612009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 450/889] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:02.617426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20d15b-dbfa-4c9b-8f39-f775a8c0e0eb None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.617704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20d15b-dbfa-4c9b-8f39-f775a8c0e0eb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.617975 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20d15b-dbfa-4c9b-8f39-f775a8c0e0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.636924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1a20d15b-dbfa-4c9b-8f39-f775a8c0e0eb None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:02.638486 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1a20d15b-dbfa-4c9b-8f39-f775a8c0e0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:02.647395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:02.710657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 440/890] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:02.733119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a77f6a-fdab-43f1-b7a2-ba7daa8a42a3 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.733453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a77f6a-fdab-43f1-b7a2-ba7daa8a42a3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.733700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a77f6a-fdab-43f1-b7a2-ba7daa8a42a3 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.735329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 451/891] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:02.741119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c290-0b57-41aa-ac14-9edfec136971 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:02.741412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c290-0b57-41aa-ac14-9edfec136971 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:02.741713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c290-0b57-41aa-ac14-9edfec136971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:02.761004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b272c290-0b57-41aa-ac14-9edfec136971 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:02.762209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b272c290-0b57-41aa-ac14-9edfec136971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:02.832351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 441/892] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:02.977994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a77f6a-fdab-43f1-b7a2-ba7daa8a42a3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.082680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a77f6a-fdab-43f1-b7a2-ba7daa8a42a3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.109253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272c290-0b57-41aa-ac14-9edfec136971 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.118946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d38a9-b96b-4678-997b-12ab1397e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.119581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d38a9-b96b-4678-997b-12ab1397e577 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.119857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d38a9-b96b-4678-997b-12ab1397e577 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.120127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d38a9-b96b-4678-997b-12ab1397e577 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.131373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d38a9-b96b-4678-997b-12ab1397e577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-bf9d38a9-b96b-4678-997b-12ab1397e577 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:03.136148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:03.137081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:03.138179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 452/893] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 07:45:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:03.139543 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.150544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d38a9-b96b-4678-997b-12ab1397e577 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.183049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.222105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272c290-0b57-41aa-ac14-9edfec136971 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.261177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196863b3-b380-4297-9baa-8eb2e5de0e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.261889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196863b3-b380-4297-9baa-8eb2e5de0e27 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.262208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196863b3-b380-4297-9baa-8eb2e5de0e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.262581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196863b3-b380-4297-9baa-8eb2e5de0e27 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.263166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196863b3-b380-4297-9baa-8eb2e5de0e27 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.264511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196863b3-b380-4297-9baa-8eb2e5de0e27 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.270046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d38a9-b96b-4678-997b-12ab1397e577 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-196863b3-b380-4297-9baa-8eb2e5de0e27 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:03.275058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:03.276260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:03.277313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 442/894] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:03.285108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196863b3-b380-4297-9baa-8eb2e5de0e27 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.320708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8096bc-421c-4cbc-8d40-5f4f017912b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.321342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8096bc-421c-4cbc-8d40-5f4f017912b6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.321640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8096bc-421c-4cbc-8d40-5f4f017912b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.321907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8096bc-421c-4cbc-8d40-5f4f017912b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.322573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8096bc-421c-4cbc-8d40-5f4f017912b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:03.323118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8096bc-421c-4cbc-8d40-5f4f017912b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.325245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8096bc-421c-4cbc-8d40-5f4f017912b6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.337517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 453/895] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:03.341697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8096bc-421c-4cbc-8d40-5f4f017912b6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.410410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196863b3-b380-4297-9baa-8eb2e5de0e27 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.425456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.447845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29369f-04d6-4dd8-94cc-d08ff85ba339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.448608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29369f-04d6-4dd8-94cc-d08ff85ba339 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.449019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29369f-04d6-4dd8-94cc-d08ff85ba339 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.449438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29369f-04d6-4dd8-94cc-d08ff85ba339 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.450096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29369f-04d6-4dd8-94cc-d08ff85ba339 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:03.450465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29369f-04d6-4dd8-94cc-d08ff85ba339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.451882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29369f-04d6-4dd8-94cc-d08ff85ba339 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.453956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.462636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 443/896] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:03.463577 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29369f-04d6-4dd8-94cc-d08ff85ba339 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.479823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8096bc-421c-4cbc-8d40-5f4f017912b6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.525220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c20c9-ec15-4c83-8b22-01c8b7d0379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.526410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c20c9-ec15-4c83-8b22-01c8b7d0379e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.527265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c20c9-ec15-4c83-8b22-01c8b7d0379e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.527716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c20c9-ec15-4c83-8b22-01c8b7d0379e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.550938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c20c9-ec15-4c83-8b22-01c8b7d0379e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.553928 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c20c9-ec15-4c83-8b22-01c8b7d0379e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2a9c20c9-ec15-4c83-8b22-01c8b7d0379e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:03.573112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:03.574338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:03.575443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:03.575443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:03.575443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:03.577923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 454/897] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:03.583362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c20c9-ec15-4c83-8b22-01c8b7d0379e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.590465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29369f-04d6-4dd8-94cc-d08ff85ba339 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.628581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66f47-86f4-454b-af75-d1ce5bc650a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.628955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66f47-86f4-454b-af75-d1ce5bc650a0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.629212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66f47-86f4-454b-af75-d1ce5bc650a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.629493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66f47-86f4-454b-af75-d1ce5bc650a0 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.630138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab66f47-86f4-454b-af75-d1ce5bc650a0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:03.630437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab66f47-86f4-454b-af75-d1ce5bc650a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.631794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab66f47-86f4-454b-af75-d1ce5bc650a0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.642085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 444/898] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:03.642946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66f47-86f4-454b-af75-d1ce5bc650a0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.702073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c20c9-ec15-4c83-8b22-01c8b7d0379e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.707716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.733963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.742162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b775b97-cc65-4e2d-be76-27c7b279b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.743390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b775b97-cc65-4e2d-be76-27c7b279b2da None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.744292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b775b97-cc65-4e2d-be76-27c7b279b2da None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.745125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b775b97-cc65-4e2d-be76-27c7b279b2da None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.746017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b775b97-cc65-4e2d-be76-27c7b279b2da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:03.746487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b775b97-cc65-4e2d-be76-27c7b279b2da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.747548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66f47-86f4-454b-af75-d1ce5bc650a0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.751209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b775b97-cc65-4e2d-be76-27c7b279b2da None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.761344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 455/899] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:03.762818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24371d52-b751-4048-a9a2-f4047928e675 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.763096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24371d52-b751-4048-a9a2-f4047928e675 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.763362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24371d52-b751-4048-a9a2-f4047928e675 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.764718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 456/900] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:03.770087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24371d52-b751-4048-a9a2-f4047928e675 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.789967 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a419f9d-5676-4e45-bc7d-53d24eeffde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.790490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a419f9d-5676-4e45-bc7d-53d24eeffde1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.790767 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a419f9d-5676-4e45-bc7d-53d24eeffde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.791036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a419f9d-5676-4e45-bc7d-53d24eeffde1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.791732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a419f9d-5676-4e45-bc7d-53d24eeffde1 None admin] RBAC: Adding query filter params (interface=public, service_id=e2bd3c5351dc4caeb1a4fc0efb4cc66a, region_id=RegionOne) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:03.792037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a419f9d-5676-4e45-bc7d-53d24eeffde1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.793382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a419f9d-5676-4e45-bc7d-53d24eeffde1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.802200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 445/901] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/endpoints?service_id=e2bd3c5351dc4caeb1a4fc0efb4cc66a&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:03.802200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452735-a91a-45eb-87da-af6803e3d14e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.802200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452735-a91a-45eb-87da-af6803e3d14e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.802200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452735-a91a-45eb-87da-af6803e3d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.822063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7d452735-a91a-45eb-87da-af6803e3d14e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:03.823254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7d452735-a91a-45eb-87da-af6803e3d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:03.886170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24371d52-b751-4048-a9a2-f4047928e675 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:03.895336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 446/902] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:03.896787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452735-a91a-45eb-87da-af6803e3d14e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.921575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc866e6-5666-4a05-ba88-fe0db0ea0aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:03.922247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc866e6-5666-4a05-ba88-fe0db0ea0aac None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:03.923012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc866e6-5666-4a05-ba88-fe0db0ea0aac None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:03.923414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc866e6-5666-4a05-ba88-fe0db0ea0aac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:03.931184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc866e6-5666-4a05-ba88-fe0db0ea0aac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:03.932632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc866e6-5666-4a05-ba88-fe0db0ea0aac None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-0bc866e6-5666-4a05-ba88-fe0db0ea0aac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:03.945620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:03.946577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:03.947544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:03.951520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 457/903] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:03.952350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc866e6-5666-4a05-ba88-fe0db0ea0aac None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:03.979655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.988173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.025886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452735-a91a-45eb-87da-af6803e3d14e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.064379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544a069-3233-4fbb-bfb6-a51020abab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.065477 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc866e6-5666-4a05-ba88-fe0db0ea0aac None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.065682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a069-3233-4fbb-bfb6-a51020abab09 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.066150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a069-3233-4fbb-bfb6-a51020abab09 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.066636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a069-3233-4fbb-bfb6-a51020abab09 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.067441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544a069-3233-4fbb-bfb6-a51020abab09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.069120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544a069-3233-4fbb-bfb6-a51020abab09 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.075599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 447/904] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:45:04.109406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4e2d4-4912-4a50-b6e2-9e60481d8770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.110805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4e2d4-4912-4a50-b6e2-9e60481d8770 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.111112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4e2d4-4912-4a50-b6e2-9e60481d8770 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.111387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4e2d4-4912-4a50-b6e2-9e60481d8770 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.112211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4e2d4-4912-4a50-b6e2-9e60481d8770 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:04.112516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4e2d4-4912-4a50-b6e2-9e60481d8770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.114095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4e2d4-4912-4a50-b6e2-9e60481d8770 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.135725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 458/905] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 07:45:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:04.141683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544a069-3233-4fbb-bfb6-a51020abab09 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.153695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e3170-1777-4d8d-a1fc-2a2ea1920bef None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.153971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e3170-1777-4d8d-a1fc-2a2ea1920bef None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.154243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e3170-1777-4d8d-a1fc-2a2ea1920bef None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.157641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 459/906] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:04.162616 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178504-146e-47cb-b121-1b5ace082be8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.162914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178504-146e-47cb-b121-1b5ace082be8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.163159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45178504-146e-47cb-b121-1b5ace082be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.184150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-45178504-146e-47cb-b121-1b5ace082be8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:04.186133 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-45178504-146e-47cb-b121-1b5ace082be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:04.262270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 460/907] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:04.264543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544a069-3233-4fbb-bfb6-a51020abab09 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.266609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178504-146e-47cb-b121-1b5ace082be8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.290332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.298690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.303563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397837f-ee68-43ba-add6-85f81167a192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.305981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397837f-ee68-43ba-add6-85f81167a192 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.305981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397837f-ee68-43ba-add6-85f81167a192 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.305981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397837f-ee68-43ba-add6-85f81167a192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.386032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397837f-ee68-43ba-add6-85f81167a192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.388195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397837f-ee68-43ba-add6-85f81167a192 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.400001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45178504-146e-47cb-b121-1b5ace082be8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.436954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e41e-96a7-4b0a-a7c5-190e47f48080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.437625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e41e-96a7-4b0a-a7c5-190e47f48080 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.437905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e41e-96a7-4b0a-a7c5-190e47f48080 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.438223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202e41e-96a7-4b0a-a7c5-190e47f48080 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.438869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e41e-96a7-4b0a-a7c5-190e47f48080 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.440244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202e41e-96a7-4b0a-a7c5-190e47f48080 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.506169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 461/908] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:04 2022] POST /identity/v3/services => generated 241 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:04.519988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 448/909] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:04 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:04.525878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e41e-96a7-4b0a-a7c5-190e47f48080 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.533585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397837f-ee68-43ba-add6-85f81167a192 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.563152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.622227 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.648649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397837f-ee68-43ba-add6-85f81167a192 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.650241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202e41e-96a7-4b0a-a7c5-190e47f48080 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.692064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0813b-98bd-4f79-8750-e3f1e261a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.692718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0813b-98bd-4f79-8750-e3f1e261a596 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.692996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0813b-98bd-4f79-8750-e3f1e261a596 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.693270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0813b-98bd-4f79-8750-e3f1e261a596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.694164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c653-ce93-43e7-826b-86e181830324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.695640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c653-ce93-43e7-826b-86e181830324 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.696264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c653-ce93-43e7-826b-86e181830324 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.696687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c653-ce93-43e7-826b-86e181830324 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.697830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1c653-ce93-43e7-826b-86e181830324 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.699339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1c653-ce93-43e7-826b-86e181830324 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.711368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0813b-98bd-4f79-8750-e3f1e261a596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-16c1c653-ce93-43e7-826b-86e181830324 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:04.712225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:04.713371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:45:04.714507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:04.715331 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0813b-98bd-4f79-8750-e3f1e261a596 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.717041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 449/910] 10.222.0.58 () {56 vars in 1132 bytes} [Wed Aug 24 07:45:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:04.726014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c653-ce93-43e7-826b-86e181830324 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d3b0813b-98bd-4f79-8750-e3f1e261a596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:04.735522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:04.736599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:04.737537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:04.737537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:04.737537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:04.738183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 462/911] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:04.744209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0813b-98bd-4f79-8750-e3f1e261a596 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.821175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.833932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c653-ce93-43e7-826b-86e181830324 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.855195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0813b-98bd-4f79-8750-e3f1e261a596 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:04.871703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f9928-bfe3-4522-a5a1-0623e0269292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.872705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9928-bfe3-4522-a5a1-0623e0269292 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.873197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9928-bfe3-4522-a5a1-0623e0269292 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.873705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9928-bfe3-4522-a5a1-0623e0269292 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.874538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f9928-bfe3-4522-a5a1-0623e0269292 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:04.875060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f9928-bfe3-4522-a5a1-0623e0269292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.877426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f9928-bfe3-4522-a5a1-0623e0269292 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.882911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 450/912] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:04.888346 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:04.890107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f9928-bfe3-4522-a5a1-0623e0269292 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:04.899660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93137d23-e495-48b0-a7e8-8b1a215ff6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:04.900325 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93137d23-e495-48b0-a7e8-8b1a215ff6fa None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:04.900601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93137d23-e495-48b0-a7e8-8b1a215ff6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:04.900917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93137d23-e495-48b0-a7e8-8b1a215ff6fa None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:04.901644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93137d23-e495-48b0-a7e8-8b1a215ff6fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:04.901948 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93137d23-e495-48b0-a7e8-8b1a215ff6fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:04.903919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93137d23-e495-48b0-a7e8-8b1a215ff6fa None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:04.921680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 463/913] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:04.926564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93137d23-e495-48b0-a7e8-8b1a215ff6fa None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:05.027067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f9928-bfe3-4522-a5a1-0623e0269292 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:05.064913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93137d23-e495-48b0-a7e8-8b1a215ff6fa None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:05.074122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefad6c-bece-4ba4-98ca-ba58aae4c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:05.075353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefad6c-bece-4ba4-98ca-ba58aae4c0cc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.075832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefad6c-bece-4ba4-98ca-ba58aae4c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.076318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefad6c-bece-4ba4-98ca-ba58aae4c0cc None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.077569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefad6c-bece-4ba4-98ca-ba58aae4c0cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:05.078172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefad6c-bece-4ba4-98ca-ba58aae4c0cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:05.080588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefad6c-bece-4ba4-98ca-ba58aae4c0cc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:05.092129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 451/914] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:05.093586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefad6c-bece-4ba4-98ca-ba58aae4c0cc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:05.103666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4138-53d4-4ecc-a216-a4e5a6608f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:05.104390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4138-53d4-4ecc-a216-a4e5a6608f5b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.104740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4138-53d4-4ecc-a216-a4e5a6608f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.105080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4138-53d4-4ecc-a216-a4e5a6608f5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.111005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:05.113331 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a4138-53d4-4ecc-a216-a4e5a6608f5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:05.114941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a4138-53d4-4ecc-a216-a4e5a6608f5b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1e2a4138-53d4-4ecc-a216-a4e5a6608f5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:05.127759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:05.128658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:05.129965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:05.129965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:05.129965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:05.129965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:05.129965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:05.129965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:05.129965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:05.129965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:05.134048 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 464/915] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:05.135077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4138-53d4-4ecc-a216-a4e5a6608f5b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:05.187959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:05.214879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefad6c-bece-4ba4-98ca-ba58aae4c0cc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:05.249631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4138-53d4-4ecc-a216-a4e5a6608f5b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:05.267753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b673fa9-49a5-4763-ba79-7bac2efb6299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:05.268374 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b673fa9-49a5-4763-ba79-7bac2efb6299 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.268646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b673fa9-49a5-4763-ba79-7bac2efb6299 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.268915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b673fa9-49a5-4763-ba79-7bac2efb6299 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.269627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b673fa9-49a5-4763-ba79-7bac2efb6299 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:05.271094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b673fa9-49a5-4763-ba79-7bac2efb6299 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:05.291576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4e6f-f6d6-4f29-8120-7ca91c364dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:05.292291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4e6f-f6d6-4f29-8120-7ca91c364dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.292622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4e6f-f6d6-4f29-8120-7ca91c364dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.295076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b4e6f-f6d6-4f29-8120-7ca91c364dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.295076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4e6f-f6d6-4f29-8120-7ca91c364dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:05.295076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4e6f-f6d6-4f29-8120-7ca91c364dc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:05.295657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b4e6f-f6d6-4f29-8120-7ca91c364dc9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:05.308670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 465/916] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:05.315105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4e6f-f6d6-4f29-8120-7ca91c364dc9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:05.358273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 452/917] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:05.447714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b4e6f-f6d6-4f29-8120-7ca91c364dc9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:05.459548 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:05.493734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653051f4-3a83-4f4a-bd8c-042842949365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:05.494351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653051f4-3a83-4f4a-bd8c-042842949365 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:05.495032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653051f4-3a83-4f4a-bd8c-042842949365 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:05.495646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653051f4-3a83-4f4a-bd8c-042842949365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:05.496863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653051f4-3a83-4f4a-bd8c-042842949365 None admin] RBAC: Adding query filter params (role.id=77f77a268f804d579d79685e961299d2, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=97a62895f65f4e6aaa23d2941ed43d79) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:05.497165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653051f4-3a83-4f4a-bd8c-042842949365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:05.498647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653051f4-3a83-4f4a-bd8c-042842949365 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:05.508685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 466/918] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:05 2022] GET /identity/v3/role_assignments?user.id=97a62895f65f4e6aaa23d2941ed43d79&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=77f77a268f804d579d79685e961299d2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:06.240806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f9e35-7fdb-49ac-bf9d-c77cfe06673d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.241316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f9e35-7fdb-49ac-bf9d-c77cfe06673d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.241392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f9e35-7fdb-49ac-bf9d-c77cfe06673d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.242863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 453/919] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:06.248516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ef632-742c-47e0-bcad-87275c9fdeb3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.248916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ef632-742c-47e0-bcad-87275c9fdeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.249092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ef632-742c-47e0-bcad-87275c9fdeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.267918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a03ef632-742c-47e0-bcad-87275c9fdeb3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:06.269107 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a03ef632-742c-47e0-bcad-87275c9fdeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:06.342995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 467/920] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:06.615183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f9e35-7fdb-49ac-bf9d-c77cfe06673d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:06.661097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dc86e-3c1d-4769-9c6b-171a8ac8165d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.661421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dc86e-3c1d-4769-9c6b-171a8ac8165d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.661664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dc86e-3c1d-4769-9c6b-171a8ac8165d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.663812 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 468/921] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:06.669861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca49e6-66a8-4f4b-9434-d0ea14d9d7c4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.670382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca49e6-66a8-4f4b-9434-d0ea14d9d7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.670661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca49e6-66a8-4f4b-9434-d0ea14d9d7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.691829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-33ca49e6-66a8-4f4b-9434-d0ea14d9d7c4 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:06.693394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-33ca49e6-66a8-4f4b-9434-d0ea14d9d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:06.701994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:06.742905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f9e35-7fdb-49ac-bf9d-c77cfe06673d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:06.777778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 469/922] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:06.784976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f093c1-7f18-42f2-b4d4-1027365008d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:06.785889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f093c1-7f18-42f2-b4d4-1027365008d8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.786360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f093c1-7f18-42f2-b4d4-1027365008d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.786861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f093c1-7f18-42f2-b4d4-1027365008d8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.787626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f093c1-7f18-42f2-b4d4-1027365008d8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:06.789187 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f093c1-7f18-42f2-b4d4-1027365008d8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-e9f093c1-7f18-42f2-b4d4-1027365008d8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:06.798637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:06.799607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:45:06.800440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:06.807705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 454/923] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:06.809304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca49e6-66a8-4f4b-9434-d0ea14d9d7c4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:06.838577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:06.913145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca49e6-66a8-4f4b-9434-d0ea14d9d7c4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:06.948760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3758823-1aed-409b-9fb4-18487e0c1830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:06.949789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3758823-1aed-409b-9fb4-18487e0c1830 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:06.950287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3758823-1aed-409b-9fb4-18487e0c1830 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:06.950746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3758823-1aed-409b-9fb4-18487e0c1830 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:06.951565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3758823-1aed-409b-9fb4-18487e0c1830 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:06.952055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3758823-1aed-409b-9fb4-18487e0c1830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:06.954129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3758823-1aed-409b-9fb4-18487e0c1830 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:06.963956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 470/924] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:06.965763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f093c1-7f18-42f2-b4d4-1027365008d8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.049399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3758823-1aed-409b-9fb4-18487e0c1830 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.076957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f093c1-7f18-42f2-b4d4-1027365008d8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.123917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e85dd9-e47e-461b-9553-b1f00b310f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.125120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e85dd9-e47e-461b-9553-b1f00b310f63 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.125631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e85dd9-e47e-461b-9553-b1f00b310f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.126096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e85dd9-e47e-461b-9553-b1f00b310f63 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.127154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e85dd9-e47e-461b-9553-b1f00b310f63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:07.128438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e85dd9-e47e-461b-9553-b1f00b310f63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.130028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e85dd9-e47e-461b-9553-b1f00b310f63 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.131556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.137550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 455/925] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 07:45:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:07.143547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e85dd9-e47e-461b-9553-b1f00b310f63 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.157381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.167277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3758823-1aed-409b-9fb4-18487e0c1830 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.207525 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aa79a-7595-4ec0-a5ee-69cd7d6d7968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.208603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aa79a-7595-4ec0-a5ee-69cd7d6d7968 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.209066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aa79a-7595-4ec0-a5ee-69cd7d6d7968 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.209821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aa79a-7595-4ec0-a5ee-69cd7d6d7968 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.210589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aa79a-7595-4ec0-a5ee-69cd7d6d7968 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.212249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aa79a-7595-4ec0-a5ee-69cd7d6d7968 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-027aa79a-7595-4ec0-a5ee-69cd7d6d7968 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:07.223338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:07.224396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:07.225260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:07.233038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 471/926] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:07.234323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aa79a-7595-4ec0-a5ee-69cd7d6d7968 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.270678 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e85dd9-e47e-461b-9553-b1f00b310f63 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.307657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92652dc-86f0-44d3-9575-bc2d4979d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.308647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92652dc-86f0-44d3-9575-bc2d4979d4f6 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.309142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92652dc-86f0-44d3-9575-bc2d4979d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.309775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92652dc-86f0-44d3-9575-bc2d4979d4f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.310669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92652dc-86f0-44d3-9575-bc2d4979d4f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.312237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92652dc-86f0-44d3-9575-bc2d4979d4f6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.356817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aa79a-7595-4ec0-a5ee-69cd7d6d7968 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.395449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79e291-d637-47db-b60f-1883530cbc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.396052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79e291-d637-47db-b60f-1883530cbc54 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.396323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79e291-d637-47db-b60f-1883530cbc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.396676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79e291-d637-47db-b60f-1883530cbc54 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.397306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79e291-d637-47db-b60f-1883530cbc54 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:07.397631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79e291-d637-47db-b60f-1883530cbc54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.398980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79e291-d637-47db-b60f-1883530cbc54 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.404060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 472/927] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:07.410572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79e291-d637-47db-b60f-1883530cbc54 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.435132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.450281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 456/928] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:07.452242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8cae3-028d-4740-829e-167ff0b8f9b5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.452531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8cae3-028d-4740-829e-167ff0b8f9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.453296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8cae3-028d-4740-829e-167ff0b8f9b5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.456201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 457/929] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:07.462377 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb085-def6-464b-98a2-86b7ef8a0c48 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.462685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb085-def6-464b-98a2-86b7ef8a0c48 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.462937 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbb085-def6-464b-98a2-86b7ef8a0c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.485380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1cfbb085-def6-464b-98a2-86b7ef8a0c48 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:07.486677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1cfbb085-def6-464b-98a2-86b7ef8a0c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:07.533599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79e291-d637-47db-b60f-1883530cbc54 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.547817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.574115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 458/930] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:07.575691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819df57-f7e9-45c1-939e-0e8125231702 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.576127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819df57-f7e9-45c1-939e-0e8125231702 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.576547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819df57-f7e9-45c1-939e-0e8125231702 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.578427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 459/931] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:07.578563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa589030-62a6-48fa-bbe4-ff8e9d59c15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.579641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589030-62a6-48fa-bbe4-ff8e9d59c15a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.579910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589030-62a6-48fa-bbe4-ff8e9d59c15a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.580260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa589030-62a6-48fa-bbe4-ff8e9d59c15a None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.580903 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa589030-62a6-48fa-bbe4-ff8e9d59c15a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:07.581199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa589030-62a6-48fa-bbe4-ff8e9d59c15a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.585516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa589030-62a6-48fa-bbe4-ff8e9d59c15a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.588482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 473/932] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:07.595077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c74bf-49c6-43bd-8165-0bfa614b70e6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.595355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c74bf-49c6-43bd-8165-0bfa614b70e6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.595572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c74bf-49c6-43bd-8165-0bfa614b70e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.595938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa589030-62a6-48fa-bbe4-ff8e9d59c15a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.617730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-901c74bf-49c6-43bd-8165-0bfa614b70e6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:07.618992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-901c74bf-49c6-43bd-8165-0bfa614b70e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:07.694360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 460/933] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:07.715939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.722185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa589030-62a6-48fa-bbe4-ff8e9d59c15a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.758356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574952b0-c398-4de8-ad34-6d2771a6451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.759056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574952b0-c398-4de8-ad34-6d2771a6451e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.759708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574952b0-c398-4de8-ad34-6d2771a6451e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.759979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574952b0-c398-4de8-ad34-6d2771a6451e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.760681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574952b0-c398-4de8-ad34-6d2771a6451e None admin] RBAC: Adding query filter params (interface=public, service_id=cdc02bd9dee7447f9586314c96ab2822, region_id=RegionOne) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:07.761358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574952b0-c398-4de8-ad34-6d2771a6451e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.763158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574952b0-c398-4de8-ad34-6d2771a6451e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.768894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 474/934] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/endpoints?service_id=cdc02bd9dee7447f9586314c96ab2822&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:07.774132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c74bf-49c6-43bd-8165-0bfa614b70e6 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.857517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574952b0-c398-4de8-ad34-6d2771a6451e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.878813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c74bf-49c6-43bd-8165-0bfa614b70e6 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:07.889795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:07.915548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6711e-20c7-4f4d-b6fa-d76a0fa33189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:07.916151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6711e-20c7-4f4d-b6fa-d76a0fa33189 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:07.916465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6711e-20c7-4f4d-b6fa-d76a0fa33189 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:07.916738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6711e-20c7-4f4d-b6fa-d76a0fa33189 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:07.917432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6711e-20c7-4f4d-b6fa-d76a0fa33189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:07.918836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6711e-20c7-4f4d-b6fa-d76a0fa33189 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:07.926275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 461/935] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:45:07.979586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6711e-20c7-4f4d-b6fa-d76a0fa33189 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:07.987885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574952b0-c398-4de8-ad34-6d2771a6451e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.035849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b98ca1-d143-40d9-829e-3b223b3b65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.037178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b98ca1-d143-40d9-829e-3b223b3b65e0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.037585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b98ca1-d143-40d9-829e-3b223b3b65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.037930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b98ca1-d143-40d9-829e-3b223b3b65e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.038909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b98ca1-d143-40d9-829e-3b223b3b65e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.040701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b98ca1-d143-40d9-829e-3b223b3b65e0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-a9b98ca1-d143-40d9-829e-3b223b3b65e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:08.053981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:08.055085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:08.055924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 475/936] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:08.061195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b98ca1-d143-40d9-829e-3b223b3b65e0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.097876 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.109349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6711e-20c7-4f4d-b6fa-d76a0fa33189 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.147289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7014f-6cf7-489a-8d81-d5dab9a4b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.148335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7014f-6cf7-489a-8d81-d5dab9a4b56f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.148818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7014f-6cf7-489a-8d81-d5dab9a4b56f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.149294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7014f-6cf7-489a-8d81-d5dab9a4b56f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.161286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7014f-6cf7-489a-8d81-d5dab9a4b56f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-36b7014f-6cf7-489a-8d81-d5dab9a4b56f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:08.166519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:08.167467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:08.168334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:08.171012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 462/937] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 07:45:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:08.177205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7014f-6cf7-489a-8d81-d5dab9a4b56f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.195920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b98ca1-d143-40d9-829e-3b223b3b65e0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.215212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.242530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35438416-1fa7-4349-b81d-b2519f06bdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.243382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35438416-1fa7-4349-b81d-b2519f06bdea None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.243663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35438416-1fa7-4349-b81d-b2519f06bdea None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.244191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35438416-1fa7-4349-b81d-b2519f06bdea None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.244827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35438416-1fa7-4349-b81d-b2519f06bdea None admin] RBAC: Adding query filter params (name=compute) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:08.245125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35438416-1fa7-4349-b81d-b2519f06bdea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.246974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35438416-1fa7-4349-b81d-b2519f06bdea None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.257547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 476/938] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:08.262595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35438416-1fa7-4349-b81d-b2519f06bdea None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.294979 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7014f-6cf7-489a-8d81-d5dab9a4b56f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.340275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1800d-932a-44e7-b1ea-5c531df74e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.341882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1800d-932a-44e7-b1ea-5c531df74e01 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.342376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1800d-932a-44e7-b1ea-5c531df74e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.342855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1800d-932a-44e7-b1ea-5c531df74e01 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.344175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1800d-932a-44e7-b1ea-5c531df74e01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:08.345159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1800d-932a-44e7-b1ea-5c531df74e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.346717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1800d-932a-44e7-b1ea-5c531df74e01 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.353272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.363347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 463/939] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:08.365721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1800d-932a-44e7-b1ea-5c531df74e01 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.397121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35438416-1fa7-4349-b81d-b2519f06bdea None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.441081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1660f-4e4a-4264-89f5-7b8c2c4ee72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.442143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1660f-4e4a-4264-89f5-7b8c2c4ee72d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.442707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1660f-4e4a-4264-89f5-7b8c2c4ee72d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.443194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1660f-4e4a-4264-89f5-7b8c2c4ee72d None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.444065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1660f-4e4a-4264-89f5-7b8c2c4ee72d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:08.444551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1660f-4e4a-4264-89f5-7b8c2c4ee72d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.446256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1660f-4e4a-4264-89f5-7b8c2c4ee72d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.451872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 477/940] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:08.486861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.493231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1800d-932a-44e7-b1ea-5c531df74e01 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.534028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1444b-8310-4678-a1b5-00102ec0e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.534950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1444b-8310-4678-a1b5-00102ec0e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.535226 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1444b-8310-4678-a1b5-00102ec0e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.535493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1444b-8310-4678-a1b5-00102ec0e2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.546964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1444b-8310-4678-a1b5-00102ec0e2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.548972 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1444b-8310-4678-a1b5-00102ec0e2b5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a5d1444b-8310-4678-a1b5-00102ec0e2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:08.566858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:08.567887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:08.568802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:08.568802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:08.568802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:08.568802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 464/941] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:08.575370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1660f-4e4a-4264-89f5-7b8c2c4ee72d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.693631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1660f-4e4a-4264-89f5-7b8c2c4ee72d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.729613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c74ae-cc98-47f3-8fa0-226918aa4d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.730618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c74ae-cc98-47f3-8fa0-226918aa4d43 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.731129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c74ae-cc98-47f3-8fa0-226918aa4d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.731603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c74ae-cc98-47f3-8fa0-226918aa4d43 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.732443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c74ae-cc98-47f3-8fa0-226918aa4d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:08.732945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c74ae-cc98-47f3-8fa0-226918aa4d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.734528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c74ae-cc98-47f3-8fa0-226918aa4d43 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.737537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.751070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 478/942] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:08.753836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1444b-8310-4678-a1b5-00102ec0e2b5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:08.856868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1444b-8310-4678-a1b5-00102ec0e2b5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:08.894157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722cab2-ce90-423e-a686-81d5449a9cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:08.894794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722cab2-ce90-423e-a686-81d5449a9cea None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:08.895072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722cab2-ce90-423e-a686-81d5449a9cea None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:08.895341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722cab2-ce90-423e-a686-81d5449a9cea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:08.903185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722cab2-ce90-423e-a686-81d5449a9cea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:08.904618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722cab2-ce90-423e-a686-81d5449a9cea None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1722cab2-ce90-423e-a686-81d5449a9cea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:08.916376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:08.917346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:08.918952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 465/943] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:08.924295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c74ae-cc98-47f3-8fa0-226918aa4d43 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.040640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c74ae-cc98-47f3-8fa0-226918aa4d43 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.077651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344cf5-023f-436c-89c4-3bd499d06429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.078315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344cf5-023f-436c-89c4-3bd499d06429 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.078628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344cf5-023f-436c-89c4-3bd499d06429 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.078957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a344cf5-023f-436c-89c4-3bd499d06429 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.080037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344cf5-023f-436c-89c4-3bd499d06429 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:09.080342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344cf5-023f-436c-89c4-3bd499d06429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.081796 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a344cf5-023f-436c-89c4-3bd499d06429 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.100664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 479/944] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 07:45:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:09.106085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722cab2-ce90-423e-a686-81d5449a9cea None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.119538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.221975 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722cab2-ce90-423e-a686-81d5449a9cea None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.257439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abba368-b8ac-4a71-aa92-21e506beb401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.258093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abba368-b8ac-4a71-aa92-21e506beb401 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.258370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abba368-b8ac-4a71-aa92-21e506beb401 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.258636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abba368-b8ac-4a71-aa92-21e506beb401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.269632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abba368-b8ac-4a71-aa92-21e506beb401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.271163 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abba368-b8ac-4a71-aa92-21e506beb401 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-3abba368-b8ac-4a71-aa92-21e506beb401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:09.285788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:09.286751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:09.288211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:09.288211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:09.288211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:09.288211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 466/945] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:09.294630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344cf5-023f-436c-89c4-3bd499d06429 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.354936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.401849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a344cf5-023f-436c-89c4-3bd499d06429 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.440214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e836cae-8c24-4be3-83d3-362ae453d50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.440835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e836cae-8c24-4be3-83d3-362ae453d50e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.441110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e836cae-8c24-4be3-83d3-362ae453d50e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.441380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e836cae-8c24-4be3-83d3-362ae453d50e None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.442054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e836cae-8c24-4be3-83d3-362ae453d50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:09.442351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e836cae-8c24-4be3-83d3-362ae453d50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.443710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e836cae-8c24-4be3-83d3-362ae453d50e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.456384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 480/946] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:09.461673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abba368-b8ac-4a71-aa92-21e506beb401 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.493655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b1c8-1b51-476e-8479-c87f2dc6d443 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.493979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b1c8-1b51-476e-8479-c87f2dc6d443 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.494233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b1c8-1b51-476e-8479-c87f2dc6d443 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.496227 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 481/947] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:09.501619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06af2-acca-4df3-bc78-12ea2d0f5767 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.501909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06af2-acca-4df3-bc78-12ea2d0f5767 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.502186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06af2-acca-4df3-bc78-12ea2d0f5767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.521149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-52f06af2-acca-4df3-bc78-12ea2d0f5767 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:09.522381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-52f06af2-acca-4df3-bc78-12ea2d0f5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:09.541886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.576959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abba368-b8ac-4a71-aa92-21e506beb401 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.617491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 482/948] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:09.617687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f1379-66d7-4ffc-8c3b-515791bbe2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.617687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f1379-66d7-4ffc-8c3b-515791bbe2de None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.617687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f1379-66d7-4ffc-8c3b-515791bbe2de None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.617932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f1379-66d7-4ffc-8c3b-515791bbe2de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.625106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f1379-66d7-4ffc-8c3b-515791bbe2de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.627704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f1379-66d7-4ffc-8c3b-515791bbe2de None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-b23f1379-66d7-4ffc-8c3b-515791bbe2de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:09.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:09.642542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:09.643583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:09.643583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:09.643583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:09.643583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:09.643583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:09.643583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:09.643583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:09.643583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:09.643583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 467/949] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:09.648535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f06af2-acca-4df3-bc78-12ea2d0f5767 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.700220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.754406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f06af2-acca-4df3-bc78-12ea2d0f5767 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.790032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac215-a108-481c-a25d-5164866905e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.790645 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac215-a108-481c-a25d-5164866905e0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.790922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac215-a108-481c-a25d-5164866905e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.791193 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beac215-a108-481c-a25d-5164866905e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.791885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac215-a108-481c-a25d-5164866905e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:09.792190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac215-a108-481c-a25d-5164866905e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.793640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beac215-a108-481c-a25d-5164866905e0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:09.806730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 483/950] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:09.812570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f1379-66d7-4ffc-8c3b-515791bbe2de None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.898446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac215-a108-481c-a25d-5164866905e0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:09.926545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f1379-66d7-4ffc-8c3b-515791bbe2de None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:09.952084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:09.973305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5776e1e-93c5-416d-8c02-0bc08e3f7ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:09.974280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776e1e-93c5-416d-8c02-0bc08e3f7ef7 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:09.974707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776e1e-93c5-416d-8c02-0bc08e3f7ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:09.975321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5776e1e-93c5-416d-8c02-0bc08e3f7ef7 None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/97a62895f65f4e6aaa23d2941ed43d79/roles/77f77a268f804d579d79685e961299d2` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:09.978686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5776e1e-93c5-416d-8c02-0bc08e3f7ef7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=97a62895f65f4e6aaa23d2941ed43d79, role_id=77f77a268f804d579d79685e961299d2)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:09.981494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5776e1e-93c5-416d-8c02-0bc08e3f7ef7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.012495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beac215-a108-481c-a25d-5164866905e0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.015738 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.048391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.048993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.049271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.049575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.050220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.051654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.054279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING keystone.server.flask.common [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 07:45:10.058063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 468/951] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:09 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/97a62895f65f4e6aaa23d2941ed43d79/roles/77f77a268f804d579d79685e961299d2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:10.060132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45c31-2ad8-49f4-86ed-a2734dda3451 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.060580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45c31-2ad8-49f4-86ed-a2734dda3451 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.061002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45c31-2ad8-49f4-86ed-a2734dda3451 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.068019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 469/952] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:10.075271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22ac4-706e-444c-81d9-f80e76ecefc7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.075789 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22ac4-706e-444c-81d9-f80e76ecefc7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.076348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22ac4-706e-444c-81d9-f80e76ecefc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.099015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b4d22ac4-706e-444c-81d9-f80e76ecefc7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:10.100313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b4d22ac4-706e-444c-81d9-f80e76ecefc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:10.120262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.sql.core [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:45:10.120262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 07:45:10.120262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [parameters: {'id': '38776aefcc10445ba963a0077972b85b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 07:45:10.120262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81783) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38776aefcc10445ba963a0077972b85b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38776aefcc10445ba963a0077972b85b. Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:10.129414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 07:45:10.130372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application yield resource Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise self.value Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application session.commit() Aug 24 07:45:10.131334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:45:10.132225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:45:10.133142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:10.133992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [parameters: {'id': '38776aefcc10445ba963a0077972b85b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.135244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:10.136427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:10.138792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:10.138792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 07:45:10.138792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 07:45:10.138792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:10.138792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:10.138792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 07:45:10.138792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 07:45:10.138792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38776aefcc10445ba963a0077972b85b. Aug 24 07:45:10.138792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.142442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 484/953] 10.222.0.58 () {60 vars in 1140 bytes} [Wed Aug 24 07:45:09 2022] POST /identity/v3/projects => generated 262 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:10.151111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.193497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 470/954] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:10.273848 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f156e26-8a98-4d84-8c2b-8aec0929c015 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.308767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096fde7-67b9-4f16-86cb-64a4395ebed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.309394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096fde7-67b9-4f16-86cb-64a4395ebed3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.309689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096fde7-67b9-4f16-86cb-64a4395ebed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.309955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096fde7-67b9-4f16-86cb-64a4395ebed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.317156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096fde7-67b9-4f16-86cb-64a4395ebed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.320809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096fde7-67b9-4f16-86cb-64a4395ebed3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-e096fde7-67b9-4f16-86cb-64a4395ebed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:10.330718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:10.331642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:10.333036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:10.333036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:10.333036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:10.333036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:10.333036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:10.333036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:10.333036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:10.333036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.333036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 485/955] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:10.338081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22ac4-706e-444c-81d9-f80e76ecefc7 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.448515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22ac4-706e-444c-81d9-f80e76ecefc7 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.460308 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.489864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb95054-8ad4-4d6f-88af-4e1bdced3da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.491181 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb95054-8ad4-4d6f-88af-4e1bdced3da7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.491604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb95054-8ad4-4d6f-88af-4e1bdced3da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.492020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb95054-8ad4-4d6f-88af-4e1bdced3da7 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.492835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb95054-8ad4-4d6f-88af-4e1bdced3da7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:10.493281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb95054-8ad4-4d6f-88af-4e1bdced3da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.494907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb95054-8ad4-4d6f-88af-4e1bdced3da7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.512715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096fde7-67b9-4f16-86cb-64a4395ebed3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.513960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 471/956] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:10.546629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.564238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19f332-8a20-4303-9bfb-b9b3195c98ac None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.564500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19f332-8a20-4303-9bfb-b9b3195c98ac None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.564768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19f332-8a20-4303-9bfb-b9b3195c98ac None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.566522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 472/957] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:10.572291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c624d6-c60d-43aa-ad3d-de0bdd223ab5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.572573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c624d6-c60d-43aa-ad3d-de0bdd223ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.572852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c624d6-c60d-43aa-ad3d-de0bdd223ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.592182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b0c624d6-c60d-43aa-ad3d-de0bdd223ab5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:10.593416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b0c624d6-c60d-43aa-ad3d-de0bdd223ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:10.663946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096fde7-67b9-4f16-86cb-64a4395ebed3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.685575 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 473/958] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:10.712775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b491d0-81ce-4c4c-8b49-875f05cfb4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.713324 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b491d0-81ce-4c4c-8b49-875f05cfb4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.713628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b491d0-81ce-4c4c-8b49-875f05cfb4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.713897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b491d0-81ce-4c4c-8b49-875f05cfb4c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.714475 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b491d0-81ce-4c4c-8b49-875f05cfb4c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.715819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b491d0-81ce-4c4c-8b49-875f05cfb4c4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-26b491d0-81ce-4c4c-8b49-875f05cfb4c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:10.726406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:10.727476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:10.733342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 486/959] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:10.737085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c624d6-c60d-43aa-ad3d-de0bdd223ab5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.838237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:10.841725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c624d6-c60d-43aa-ad3d-de0bdd223ab5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:10.877737 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578d28-abe9-4153-b067-3e21ec56cd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:10.878433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578d28-abe9-4153-b067-3e21ec56cd48 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:10.878711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578d28-abe9-4153-b067-3e21ec56cd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:10.878973 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59578d28-abe9-4153-b067-3e21ec56cd48 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:10.879644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578d28-abe9-4153-b067-3e21ec56cd48 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:10.879940 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578d28-abe9-4153-b067-3e21ec56cd48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:10.881285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59578d28-abe9-4153-b067-3e21ec56cd48 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:10.886339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 474/960] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:10.892098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b491d0-81ce-4c4c-8b49-875f05cfb4c4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.968018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578d28-abe9-4153-b067-3e21ec56cd48 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:10.981095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:11.003111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b491d0-81ce-4c4c-8b49-875f05cfb4c4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:11.049132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d0d7-e0d7-4a4f-8007-ac08f55d66d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:11.049909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d0d7-e0d7-4a4f-8007-ac08f55d66d8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.050183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d0d7-e0d7-4a4f-8007-ac08f55d66d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.050510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d0d7-e0d7-4a4f-8007-ac08f55d66d8 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.051268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6d0d7-e0d7-4a4f-8007-ac08f55d66d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:11.051565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6d0d7-e0d7-4a4f-8007-ac08f55d66d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:11.053994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6d0d7-e0d7-4a4f-8007-ac08f55d66d8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:11.065578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 487/961] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:11.072022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d0d7-e0d7-4a4f-8007-ac08f55d66d8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:11.101859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59578d28-abe9-4153-b067-3e21ec56cd48 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:11.147943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6ee8-10cf-4028-a49d-c4991cd553a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:11.149674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6ee8-10cf-4028-a49d-c4991cd553a6 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.150157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6ee8-10cf-4028-a49d-c4991cd553a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.150621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6ee8-10cf-4028-a49d-c4991cd553a6 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.151472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d6ee8-10cf-4028-a49d-c4991cd553a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:11.153038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d6ee8-10cf-4028-a49d-c4991cd553a6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:11.182087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d0d7-e0d7-4a4f-8007-ac08f55d66d8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:11.220091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54ec42-a7f5-4535-ae29-811ae78c4e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:11.220606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54ec42-a7f5-4535-ae29-811ae78c4e63 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:11.220905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54ec42-a7f5-4535-ae29-811ae78c4e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:11.221157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54ec42-a7f5-4535-ae29-811ae78c4e63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:11.221914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54ec42-a7f5-4535-ae29-811ae78c4e63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:11.223277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54ec42-a7f5-4535-ae29-811ae78c4e63 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:11.236130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 475/962] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:10 2022] POST /identity/v3/services => generated 242 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:11.303737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 488/963] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:12.154616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd1f8-a378-4a1b-85b9-26e17dd3c14f None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.155173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd1f8-a378-4a1b-85b9-26e17dd3c14f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.155173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dd1f8-a378-4a1b-85b9-26e17dd3c14f None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.157265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 476/964] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:12.163265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9f34a-0fbc-43bf-b785-bcb674e85c38 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.163675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9f34a-0fbc-43bf-b785-bcb674e85c38 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.163887 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9f34a-0fbc-43bf-b785-bcb674e85c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.172061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:12.183351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-35e9f34a-0fbc-43bf-b785-bcb674e85c38 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:12.184859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-35e9f34a-0fbc-43bf-b785-bcb674e85c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:12.264359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 489/965] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:12.557165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd1f8-a378-4a1b-85b9-26e17dd3c14f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:12.583408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:12.663843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dd1f8-a378-4a1b-85b9-26e17dd3c14f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:12.696878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54f195-c626-41da-9ae7-ff2a7a9d8c09 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.697552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54f195-c626-41da-9ae7-ff2a7a9d8c09 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.698026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54f195-c626-41da-9ae7-ff2a7a9d8c09 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.699748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e320-5aac-402f-8ecd-5fa83d5a0010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:12.700004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 490/966] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:12.703880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e320-5aac-402f-8ecd-5fa83d5a0010 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.703880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e320-5aac-402f-8ecd-5fa83d5a0010 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.703880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e320-5aac-402f-8ecd-5fa83d5a0010 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.705495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6982e0-f023-4263-a83b-4b22f8f8b7d9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.706005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6982e0-f023-4263-a83b-4b22f8f8b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.706485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6982e0-f023-4263-a83b-4b22f8f8b7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.712500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e320-5aac-402f-8ecd-5fa83d5a0010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-70a6e320-5aac-402f-8ecd-5fa83d5a0010 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:12.717254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:12.718302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:12.719290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 477/967] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 07:45:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:12.724628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e320-5aac-402f-8ecd-5fa83d5a0010 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:12.729359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1b6982e0-f023-4263-a83b-4b22f8f8b7d9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:12.730639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1b6982e0-f023-4263-a83b-4b22f8f8b7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:12.809251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 491/968] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:12.820889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:12.838237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e320-5aac-402f-8ecd-5fa83d5a0010 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:12.875104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7d89c-302a-4b09-8833-bb0148bd3570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:12.876948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7d89c-302a-4b09-8833-bb0148bd3570 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:12.877514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7d89c-302a-4b09-8833-bb0148bd3570 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:12.878183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7d89c-302a-4b09-8833-bb0148bd3570 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:12.879592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7d89c-302a-4b09-8833-bb0148bd3570 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:12.880317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7d89c-302a-4b09-8833-bb0148bd3570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:12.882792 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7d89c-302a-4b09-8833-bb0148bd3570 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:12.892452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 478/969] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 07:45:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:12.898228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6982e0-f023-4263-a83b-4b22f8f8b7d9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:12.980249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.014778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6982e0-f023-4263-a83b-4b22f8f8b7d9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.053826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e239-d66d-4e6c-b56f-e55268494b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.054553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e239-d66d-4e6c-b56f-e55268494b09 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.054903 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e239-d66d-4e6c-b56f-e55268494b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.055241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e239-d66d-4e6c-b56f-e55268494b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.066169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707e239-d66d-4e6c-b56f-e55268494b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.067695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707e239-d66d-4e6c-b56f-e55268494b09 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.079889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7d89c-302a-4b09-8833-bb0148bd3570 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7707e239-d66d-4e6c-b56f-e55268494b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:13.083347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:13.084300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:13.085235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:13.085235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:13.085235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:13.085235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 492/970] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:13.090256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e239-d66d-4e6c-b56f-e55268494b09 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.194047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7d89c-302a-4b09-8833-bb0148bd3570 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.227193 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707e239-d66d-4e6c-b56f-e55268494b09 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.230352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371f7c5-68d2-43ba-bfb4-c70785e4dec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.231015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371f7c5-68d2-43ba-bfb4-c70785e4dec0 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.231287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371f7c5-68d2-43ba-bfb4-c70785e4dec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.231553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371f7c5-68d2-43ba-bfb4-c70785e4dec0 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.232240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371f7c5-68d2-43ba-bfb4-c70785e4dec0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.233740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371f7c5-68d2-43ba-bfb4-c70785e4dec0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.236518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WARNING keystone.server.flask.common [None req-a371f7c5-68d2-43ba-bfb4-c70785e4dec0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 07:45:13.241788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.263470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e0e97-e0f2-44da-88b4-7fa67796e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.264080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0e97-e0f2-44da-88b4-7fa67796e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.264355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0e97-e0f2-44da-88b4-7fa67796e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.264624 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0e97-e0f2-44da-88b4-7fa67796e6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.265266 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e0e97-e0f2-44da-88b4-7fa67796e6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:13.265596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e0e97-e0f2-44da-88b4-7fa67796e6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.267625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e0e97-e0f2-44da-88b4-7fa67796e6e2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.279541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 493/971] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:13.280778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c57f9b-f479-40a4-bcb8-ffc8df9c93b0 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.281065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c57f9b-f479-40a4-bcb8-ffc8df9c93b0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.281336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c57f9b-f479-40a4-bcb8-ffc8df9c93b0 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.282572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 494/972] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:13.285585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c57f9b-f479-40a4-bcb8-ffc8df9c93b0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.285987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.sql.core [None req-a371f7c5-68d2-43ba-bfb4-c70785e4dec0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:45:13.285987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 07:45:13.285987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [parameters: {'user_id': 'ced57822eb1f4b3a9de75da1eefe8447', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 07:45:13.285987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81784) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a371f7c5-68d2-43ba-bfb4-c70785e4dec0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:13.302814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:13.303877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application yield resource Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise self.value Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application session.commit() Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:45:13.304883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:45:13.306261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:45:13.308004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result.read() Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:45:13.310346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ced57822eb1f4b3a9de75da1eefe8447', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:13.313399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 07:45:13.315337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 479/973] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 07:45:13 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d504c-332a-4f3a-b253-1cb85049c971 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d504c-332a-4f3a-b253-1cb85049c971 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.316840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d504c-332a-4f3a-b253-1cb85049c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.333105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a99d504c-332a-4f3a-b253-1cb85049c971 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:13.334751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a99d504c-332a-4f3a-b253-1cb85049c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:13.337351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.403888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c57f9b-f479-40a4-bcb8-ffc8df9c93b0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.404111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 480/974] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:13.404823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d504c-332a-4f3a-b253-1cb85049c971 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.450622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa834c5a-50b7-4635-b62f-95da5e8b65ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.451411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa834c5a-50b7-4635-b62f-95da5e8b65ba None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.451790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa834c5a-50b7-4635-b62f-95da5e8b65ba None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.452143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa834c5a-50b7-4635-b62f-95da5e8b65ba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.459335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa834c5a-50b7-4635-b62f-95da5e8b65ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.460825 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa834c5a-50b7-4635-b62f-95da5e8b65ba None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-fa834c5a-50b7-4635-b62f-95da5e8b65ba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:13.472596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:13.478440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 495/975] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d1ec4-7444-4e1c-b1d5-6fea62f58700 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.479632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d1ec4-7444-4e1c-b1d5-6fea62f58700 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.480573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d1ec4-7444-4e1c-b1d5-6fea62f58700 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.480573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 496/976] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:13.481895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d1ec4-7444-4e1c-b1d5-6fea62f58700 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.513935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.514112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d504c-332a-4f3a-b253-1cb85049c971 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.549091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcf532-2cf6-4d81-ad46-457416b62f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.549853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcf532-2cf6-4d81-ad46-457416b62f93 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.550187 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcf532-2cf6-4d81-ad46-457416b62f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.550516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcf532-2cf6-4d81-ad46-457416b62f93 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.557492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcf532-2cf6-4d81-ad46-457416b62f93 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.559198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcf532-2cf6-4d81-ad46-457416b62f93 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.561005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-cefcf532-2cf6-4d81-ad46-457416b62f93 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:13.573775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:13.577618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 481/977] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95621b-e30b-446f-b71d-5399494865a7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.579351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95621b-e30b-446f-b71d-5399494865a7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.580117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95621b-e30b-446f-b71d-5399494865a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.595595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2c95621b-e30b-446f-b71d-5399494865a7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:13.596762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2c95621b-e30b-446f-b71d-5399494865a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:13.598154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d1ec4-7444-4e1c-b1d5-6fea62f58700 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.643605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20048-3039-4d67-8c35-8ed53eaebd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.644202 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20048-3039-4d67-8c35-8ed53eaebd69 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.644473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20048-3039-4d67-8c35-8ed53eaebd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.644739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20048-3039-4d67-8c35-8ed53eaebd69 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.645449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af20048-3039-4d67-8c35-8ed53eaebd69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:13.645770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af20048-3039-4d67-8c35-8ed53eaebd69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.647176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af20048-3039-4d67-8c35-8ed53eaebd69 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.666296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 497/978] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:13.666940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20048-3039-4d67-8c35-8ed53eaebd69 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.677944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 482/979] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:13.677944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95621b-e30b-446f-b71d-5399494865a7 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.764118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.774047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20048-3039-4d67-8c35-8ed53eaebd69 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.774962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95621b-e30b-446f-b71d-5399494865a7 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:13.802456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.810560 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d169bc1-e4d3-4424-aaab-01af7a461d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.811103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83871239-9d02-43a9-9d4f-120f7ffbda43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:13.811240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d169bc1-e4d3-4424-aaab-01af7a461d49 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.811417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d169bc1-e4d3-4424-aaab-01af7a461d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.811679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d169bc1-e4d3-4424-aaab-01af7a461d49 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.811929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83871239-9d02-43a9-9d4f-120f7ffbda43 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:13.812266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83871239-9d02-43a9-9d4f-120f7ffbda43 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:13.812427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d169bc1-e4d3-4424-aaab-01af7a461d49 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:13.812654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83871239-9d02-43a9-9d4f-120f7ffbda43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:13.812770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d169bc1-e4d3-4424-aaab-01af7a461d49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.814957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d169bc1-e4d3-4424-aaab-01af7a461d49 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.861582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 498/980] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:13.861582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d169bc1-e4d3-4424-aaab-01af7a461d49 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:13.894307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83871239-9d02-43a9-9d4f-120f7ffbda43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:13.896072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83871239-9d02-43a9-9d4f-120f7ffbda43 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:13.986798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d169bc1-e4d3-4424-aaab-01af7a461d49 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.014859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 483/981] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:14.015550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83871239-9d02-43a9-9d4f-120f7ffbda43 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.035927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a9054-2f7d-48f6-aca6-f01e1cec0e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.036663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a9054-2f7d-48f6-aca6-f01e1cec0e6d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.037013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a9054-2f7d-48f6-aca6-f01e1cec0e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.037356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a9054-2f7d-48f6-aca6-f01e1cec0e6d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.038048 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a9054-2f7d-48f6-aca6-f01e1cec0e6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.039523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a9054-2f7d-48f6-aca6-f01e1cec0e6d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.047813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2c1a9054-2f7d-48f6-aca6-f01e1cec0e6d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:14.050322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:14.051557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:14.052611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 499/982] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:14.053441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a9054-2f7d-48f6-aca6-f01e1cec0e6d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.073367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.141926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83871239-9d02-43a9-9d4f-120f7ffbda43 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.174692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a9054-2f7d-48f6-aca6-f01e1cec0e6d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.176049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9417c8-8366-4d53-8992-a3b90ba840f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.176670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9417c8-8366-4d53-8992-a3b90ba840f3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.176944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9417c8-8366-4d53-8992-a3b90ba840f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.177209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9417c8-8366-4d53-8992-a3b90ba840f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.177813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9417c8-8366-4d53-8992-a3b90ba840f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.179166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9417c8-8366-4d53-8992-a3b90ba840f3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-8c9417c8-8366-4d53-8992-a3b90ba840f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:14.187700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:14.189629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:14.190685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 484/983] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:14.192131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9417c8-8366-4d53-8992-a3b90ba840f3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.211514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e41832-fcb1-46ba-bc99-b95a2d207078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.212137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e41832-fcb1-46ba-bc99-b95a2d207078 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.212414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e41832-fcb1-46ba-bc99-b95a2d207078 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.212683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e41832-fcb1-46ba-bc99-b95a2d207078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.222958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e41832-fcb1-46ba-bc99-b95a2d207078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.224413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e41832-fcb1-46ba-bc99-b95a2d207078 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-56e41832-fcb1-46ba-bc99-b95a2d207078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:14.240447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:14.241963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:14.242873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:14.242873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:14.242873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:14.242873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 500/984] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:14.242873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e41832-fcb1-46ba-bc99-b95a2d207078 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.288395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.296934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9417c8-8366-4d53-8992-a3b90ba840f3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.306963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.337652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeebe7e-b917-48fc-b618-93e0c2599639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.338308 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeebe7e-b917-48fc-b618-93e0c2599639 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.338588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeebe7e-b917-48fc-b618-93e0c2599639 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.338859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeebe7e-b917-48fc-b618-93e0c2599639 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.339537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeebe7e-b917-48fc-b618-93e0c2599639 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.339843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeebe7e-b917-48fc-b618-93e0c2599639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.341228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeebe7e-b917-48fc-b618-93e0c2599639 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.346629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e41832-fcb1-46ba-bc99-b95a2d207078 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.349247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 485/985] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.355496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeebe7e-b917-48fc-b618-93e0c2599639 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.384914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49fffd-43d7-429f-a629-d83d95308e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.387759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49fffd-43d7-429f-a629-d83d95308e86 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.387759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49fffd-43d7-429f-a629-d83d95308e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.387759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49fffd-43d7-429f-a629-d83d95308e86 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.387759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49fffd-43d7-429f-a629-d83d95308e86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.387759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49fffd-43d7-429f-a629-d83d95308e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.388291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49fffd-43d7-429f-a629-d83d95308e86 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.393557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 501/986] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.394291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49fffd-43d7-429f-a629-d83d95308e86 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.450638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeebe7e-b917-48fc-b618-93e0c2599639 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.483099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2797de1-2dc3-4b85-889c-160bd2bf87d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.483783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2797de1-2dc3-4b85-889c-160bd2bf87d8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.484117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2797de1-2dc3-4b85-889c-160bd2bf87d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.484447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2797de1-2dc3-4b85-889c-160bd2bf87d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.485873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2797de1-2dc3-4b85-889c-160bd2bf87d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.486171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2797de1-2dc3-4b85-889c-160bd2bf87d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.487516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2797de1-2dc3-4b85-889c-160bd2bf87d8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.494272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49fffd-43d7-429f-a629-d83d95308e86 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.498773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 486/987] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.499565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2797de1-2dc3-4b85-889c-160bd2bf87d8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.519177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.523987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.531967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a731-1af9-4dd9-8cda-321cfd7000e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.532769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a731-1af9-4dd9-8cda-321cfd7000e0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.532940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a731-1af9-4dd9-8cda-321cfd7000e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.533211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90a731-1af9-4dd9-8cda-321cfd7000e0 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.533869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a731-1af9-4dd9-8cda-321cfd7000e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.534175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a731-1af9-4dd9-8cda-321cfd7000e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.535791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90a731-1af9-4dd9-8cda-321cfd7000e0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.540622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 502/988] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.541201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a731-1af9-4dd9-8cda-321cfd7000e0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.602359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2797de1-2dc3-4b85-889c-160bd2bf87d8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.636725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448819c-c503-4b4a-a993-7a4856ac6216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.637330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448819c-c503-4b4a-a993-7a4856ac6216 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.637639 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448819c-c503-4b4a-a993-7a4856ac6216 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.637910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448819c-c503-4b4a-a993-7a4856ac6216 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.638537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448819c-c503-4b4a-a993-7a4856ac6216 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.638831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448819c-c503-4b4a-a993-7a4856ac6216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.640182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448819c-c503-4b4a-a993-7a4856ac6216 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.645012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90a731-1af9-4dd9-8cda-321cfd7000e0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.645582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 487/989] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.646365 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448819c-c503-4b4a-a993-7a4856ac6216 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.684910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a20026-b4b2-4b88-a0e9-bf8594105ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.685575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20026-b4b2-4b88-a0e9-bf8594105ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.685861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20026-b4b2-4b88-a0e9-bf8594105ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.686138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20026-b4b2-4b88-a0e9-bf8594105ef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.693009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a20026-b4b2-4b88-a0e9-bf8594105ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.694488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a20026-b4b2-4b88-a0e9-bf8594105ef7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-13a20026-b4b2-4b88-a0e9-bf8594105ef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:14.705500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:14.706596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:14.707528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:14.707528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:14.707528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:14.707528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:14.707528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:14.707528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:14.707528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:14.707528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:14.707528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 503/990] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:14.708053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a20026-b4b2-4b88-a0e9-bf8594105ef7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.733824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.752269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448819c-c503-4b4a-a993-7a4856ac6216 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.759564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.787592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf4f0e-2643-441f-839b-745d15f8a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.788191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf4f0e-2643-441f-839b-745d15f8a7cc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.788473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf4f0e-2643-441f-839b-745d15f8a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.788738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf4f0e-2643-441f-839b-745d15f8a7cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.789428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf4f0e-2643-441f-839b-745d15f8a7cc None admin] RBAC: Adding query filter params (interface=public, service_id=8b68c85d918a47d7bfd60d2063e13fb8, region_id=RegionOne) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.789765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf4f0e-2643-441f-839b-745d15f8a7cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.791107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf4f0e-2643-441f-839b-745d15f8a7cc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.796177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 488/991] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/endpoints?service_id=8b68c85d918a47d7bfd60d2063e13fb8&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.796781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf4f0e-2643-441f-839b-745d15f8a7cc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.814177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a20026-b4b2-4b88-a0e9-bf8594105ef7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.847994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130abdc-c7cc-4b03-96e8-1fafa676605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.848597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130abdc-c7cc-4b03-96e8-1fafa676605d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.848875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130abdc-c7cc-4b03-96e8-1fafa676605d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.849144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130abdc-c7cc-4b03-96e8-1fafa676605d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.849878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130abdc-c7cc-4b03-96e8-1fafa676605d None admin] RBAC: Adding query filter params (interface=admin, service_id=cdc02bd9dee7447f9586314c96ab2822, region_id=RegionOne) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.850187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130abdc-c7cc-4b03-96e8-1fafa676605d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.851534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130abdc-c7cc-4b03-96e8-1fafa676605d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.856916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 504/992] 10.222.0.58 () {56 vars in 1249 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/endpoints?service_id=cdc02bd9dee7447f9586314c96ab2822&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.857736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130abdc-c7cc-4b03-96e8-1fafa676605d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.896685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf4f0e-2643-441f-839b-745d15f8a7cc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.932060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ef03-26c9-4269-81b2-2effbcfb6125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.932677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ef03-26c9-4269-81b2-2effbcfb6125 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.932955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ef03-26c9-4269-81b2-2effbcfb6125 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.933226 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ef03-26c9-4269-81b2-2effbcfb6125 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:14.933952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ef03-26c9-4269-81b2-2effbcfb6125 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:14.934258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ef03-26c9-4269-81b2-2effbcfb6125 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:14.935736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ef03-26c9-4269-81b2-2effbcfb6125 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:14.947945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 489/993] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:14.948688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ef03-26c9-4269-81b2-2effbcfb6125 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:14.952411 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.964207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130abdc-c7cc-4b03-96e8-1fafa676605d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:14.981342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.998683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7704d-1c34-45e1-b993-2930aed95fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:14.999285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7704d-1c34-45e1-b993-2930aed95fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:14.999559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7704d-1c34-45e1-b993-2930aed95fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:14.999826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7704d-1c34-45e1-b993-2930aed95fc9 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.000517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7704d-1c34-45e1-b993-2930aed95fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.001895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7704d-1c34-45e1-b993-2930aed95fc9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.007912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 505/994] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:45:15.008682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7704d-1c34-45e1-b993-2930aed95fc9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:15.063265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ef03-26c9-4269-81b2-2effbcfb6125 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.103192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c845fc-9fce-4988-aa82-f068a37c2bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.103829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c845fc-9fce-4988-aa82-f068a37c2bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.104108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c845fc-9fce-4988-aa82-f068a37c2bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.104385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c845fc-9fce-4988-aa82-f068a37c2bc7 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.105002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c845fc-9fce-4988-aa82-f068a37c2bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.106427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c845fc-9fce-4988-aa82-f068a37c2bc7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.113517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 490/995] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:14 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:45:15.134065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7704d-1c34-45e1-b993-2930aed95fc9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:15.177340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2eac2-9f84-4f19-b8a3-afdd6ae0b4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:15.178042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2eac2-9f84-4f19-b8a3-afdd6ae0b4ef None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:15.178405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2eac2-9f84-4f19-b8a3-afdd6ae0b4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:15.178769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2eac2-9f84-4f19-b8a3-afdd6ae0b4ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:15.179608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2eac2-9f84-4f19-b8a3-afdd6ae0b4ef None admin] RBAC: Adding query filter params (role.id=77f77a268f804d579d79685e961299d2, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=97a62895f65f4e6aaa23d2941ed43d79) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:15.179920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2eac2-9f84-4f19-b8a3-afdd6ae0b4ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:15.181392 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2eac2-9f84-4f19-b8a3-afdd6ae0b4ef None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:15.189659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 506/996] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:15 2022] GET /identity/v3/role_assignments?user.id=97a62895f65f4e6aaa23d2941ed43d79&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=77f77a268f804d579d79685e961299d2 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:16.959299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c427-fe86-4d0a-bf8a-3a812a531638 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.959849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c427-fe86-4d0a-bf8a-3a812a531638 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.959849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444c427-fe86-4d0a-bf8a-3a812a531638 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.961224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 491/997] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:16.966476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224d257-b6f4-4d1a-b03f-e7acc7f341dd None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:16.966868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224d257-b6f4-4d1a-b03f-e7acc7f341dd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:16.967076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224d257-b6f4-4d1a-b03f-e7acc7f341dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:16.986774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1224d257-b6f4-4d1a-b03f-e7acc7f341dd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:16.987968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1224d257-b6f4-4d1a-b03f-e7acc7f341dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:17.029450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.036171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f4dc-8b1e-4810-ae87-f275fc0954ce None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.036453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f4dc-8b1e-4810-ae87-f275fc0954ce None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.036724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605f4dc-8b1e-4810-ae87-f275fc0954ce None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.038101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 492/998] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:17.043035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b81022-ede2-4c18-9964-2f0bb5fcbfe0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.043311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b81022-ede2-4c18-9964-2f0bb5fcbfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.043577 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b81022-ede2-4c18-9964-2f0bb5fcbfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.058828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 507/999] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:17.065434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a0b81022-ede2-4c18-9964-2f0bb5fcbfe0 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:17.066628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a0b81022-ede2-4c18-9964-2f0bb5fcbfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:17.131389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.137217 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 493/1000] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:17.175437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f8a1-fd0d-4a7f-b8a7-6b86ec0f0a7d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.175749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f8a1-fd0d-4a7f-b8a7-6b86ec0f0a7d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.175989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f8a1-fd0d-4a7f-b8a7-6b86ec0f0a7d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.177525 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 508/1001] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:17.182474 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c99ea-b5d3-4813-a4cd-4e183a40ee6f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.182763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c99ea-b5d3-4813-a4cd-4e183a40ee6f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.183038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c99ea-b5d3-4813-a4cd-4e183a40ee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.200976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cd6c99ea-b5d3-4813-a4cd-4e183a40ee6f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:17.202189 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cd6c99ea-b5d3-4813-a4cd-4e183a40ee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:17.269803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 494/1002] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:17.331172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f8a1-fd0d-4a7f-b8a7-6b86ec0f0a7d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.403274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c99ea-b5d3-4813-a4cd-4e183a40ee6f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.443664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f8a1-fd0d-4a7f-b8a7-6b86ec0f0a7d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.505800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c99ea-b5d3-4813-a4cd-4e183a40ee6f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.526983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb444e-bae8-4afd-9796-6de6eb2d752e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.527532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb444e-bae8-4afd-9796-6de6eb2d752e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.527891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb444e-bae8-4afd-9796-6de6eb2d752e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.528165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb444e-bae8-4afd-9796-6de6eb2d752e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.528735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb444e-bae8-4afd-9796-6de6eb2d752e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.530127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb444e-bae8-4afd-9796-6de6eb2d752e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.533435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-71fb444e-bae8-4afd-9796-6de6eb2d752e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:17.539759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:17.540789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:17.541675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 509/1003] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:17.544620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722706e8-9053-4b17-87c9-872dd233a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.545426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722706e8-9053-4b17-87c9-872dd233a97c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.545770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722706e8-9053-4b17-87c9-872dd233a97c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.549539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722706e8-9053-4b17-87c9-872dd233a97c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.549539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722706e8-9053-4b17-87c9-872dd233a97c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.549539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722706e8-9053-4b17-87c9-872dd233a97c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.549813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb444e-bae8-4afd-9796-6de6eb2d752e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-722706e8-9053-4b17-87c9-872dd233a97c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:17.558353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:17.559507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:17.560419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 495/1004] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:17.561327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722706e8-9053-4b17-87c9-872dd233a97c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.595304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.658541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb444e-bae8-4afd-9796-6de6eb2d752e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.660089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722706e8-9053-4b17-87c9-872dd233a97c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.693849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498077c-5fdb-42e8-96dd-3ee345450eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.694455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498077c-5fdb-42e8-96dd-3ee345450eac None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.694729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498077c-5fdb-42e8-96dd-3ee345450eac None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.694996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498077c-5fdb-42e8-96dd-3ee345450eac None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.695303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f66c0-958d-42fd-9c1e-af621c377620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.695620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498077c-5fdb-42e8-96dd-3ee345450eac None admin] RBAC: Adding query filter params (name=compute) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.695917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498077c-5fdb-42e8-96dd-3ee345450eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.696005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f66c0-958d-42fd-9c1e-af621c377620 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.696186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f66c0-958d-42fd-9c1e-af621c377620 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.696453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f66c0-958d-42fd-9c1e-af621c377620 None admin] PATH_INFO: `/v3/services/image` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.697025 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f66c0-958d-42fd-9c1e-af621c377620 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.697269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498077c-5fdb-42e8-96dd-3ee345450eac None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.698390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f66c0-958d-42fd-9c1e-af621c377620 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.702006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 510/1005] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:17.702775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498077c-5fdb-42e8-96dd-3ee345450eac None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a88f66c0-958d-42fd-9c1e-af621c377620 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:17.711969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:17.713139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:17.714570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 496/1006] 10.222.0.58 () {56 vars in 1105 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:17.715588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f66c0-958d-42fd-9c1e-af621c377620 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.770178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.805263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498077c-5fdb-42e8-96dd-3ee345450eac None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.807540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.815820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f66c0-958d-42fd-9c1e-af621c377620 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.838968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1001fb-606d-4b50-b9a4-785e87ca7aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.839579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1001fb-606d-4b50-b9a4-785e87ca7aca None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.839856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1001fb-606d-4b50-b9a4-785e87ca7aca None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.840128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1001fb-606d-4b50-b9a4-785e87ca7aca None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.840751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1001fb-606d-4b50-b9a4-785e87ca7aca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.841052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1001fb-606d-4b50-b9a4-785e87ca7aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.842454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1001fb-606d-4b50-b9a4-785e87ca7aca None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.847791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 511/1007] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:17.848562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1001fb-606d-4b50-b9a4-785e87ca7aca None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.850884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98bf7-7c8b-4656-9dcc-7b9ee209a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.851541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98bf7-7c8b-4656-9dcc-7b9ee209a821 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.851874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98bf7-7c8b-4656-9dcc-7b9ee209a821 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.852269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98bf7-7c8b-4656-9dcc-7b9ee209a821 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.853009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98bf7-7c8b-4656-9dcc-7b9ee209a821 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.853312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98bf7-7c8b-4656-9dcc-7b9ee209a821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.854683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98bf7-7c8b-4656-9dcc-7b9ee209a821 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.860424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 497/1008] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:17.861201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98bf7-7c8b-4656-9dcc-7b9ee209a821 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.951656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1001fb-606d-4b50-b9a4-785e87ca7aca None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.957353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98bf7-7c8b-4656-9dcc-7b9ee209a821 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:17.977166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:17.987748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dae0df-e2a0-40bb-922d-6ec74116b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.988888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dae0df-e2a0-40bb-922d-6ec74116b565 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.988888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dae0df-e2a0-40bb-922d-6ec74116b565 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.988888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dae0df-e2a0-40bb-922d-6ec74116b565 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.989520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dae0df-e2a0-40bb-922d-6ec74116b565 None admin] RBAC: Adding query filter params (name=image) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.989823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dae0df-e2a0-40bb-922d-6ec74116b565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.990822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92696a64-e947-4346-b6d7-cc7c2e66ddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:17.991293 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dae0df-e2a0-40bb-922d-6ec74116b565 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.991403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92696a64-e947-4346-b6d7-cc7c2e66ddef None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:17.991676 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92696a64-e947-4346-b6d7-cc7c2e66ddef None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:17.991939 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92696a64-e947-4346-b6d7-cc7c2e66ddef None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:17.992651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92696a64-e947-4346-b6d7-cc7c2e66ddef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:17.992948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92696a64-e947-4346-b6d7-cc7c2e66ddef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:17.994338 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92696a64-e947-4346-b6d7-cc7c2e66ddef None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:17.996035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 512/1009] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:17.996785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dae0df-e2a0-40bb-922d-6ec74116b565 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:17.999591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 498/1010] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 07:45:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:18.001769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92696a64-e947-4346-b6d7-cc7c2e66ddef None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:18.029355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:18.099687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dae0df-e2a0-40bb-922d-6ec74116b565 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:18.101688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92696a64-e947-4346-b6d7-cc7c2e66ddef None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:18.133222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31185b8d-9e14-446d-b391-20b1e28b3cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:18.133829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13e5d-595e-4fed-9373-7be80dddf37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:18.133969 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31185b8d-9e14-446d-b391-20b1e28b3cde None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.134122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31185b8d-9e14-446d-b391-20b1e28b3cde None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.134394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31185b8d-9e14-446d-b391-20b1e28b3cde None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.134498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13e5d-595e-4fed-9373-7be80dddf37f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.134680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13e5d-595e-4fed-9373-7be80dddf37f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.134946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13e5d-595e-4fed-9373-7be80dddf37f None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.135046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31185b8d-9e14-446d-b391-20b1e28b3cde None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:18.135563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13e5d-595e-4fed-9373-7be80dddf37f None admin] RBAC: Adding query filter params (type=image) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:18.135858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13e5d-595e-4fed-9373-7be80dddf37f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:18.136395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31185b8d-9e14-446d-b391-20b1e28b3cde None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:18.137182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13e5d-595e-4fed-9373-7be80dddf37f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:18.144177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 499/1011] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:18.144554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13e5d-595e-4fed-9373-7be80dddf37f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:18.204316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:18.229494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 513/1012] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:18.267032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13e5d-595e-4fed-9373-7be80dddf37f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:18.318408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8f067-2209-4181-9111-fa22a15509ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:18.319463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f067-2209-4181-9111-fa22a15509ad None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:18.319925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f067-2209-4181-9111-fa22a15509ad None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:18.320374 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8f067-2209-4181-9111-fa22a15509ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:18.321247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8f067-2209-4181-9111-fa22a15509ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:18.322708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8f067-2209-4181-9111-fa22a15509ad None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:18.429452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 500/1013] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:20.057742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774defd-1226-4325-a8cf-6c30e9681e7b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.058255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774defd-1226-4325-a8cf-6c30e9681e7b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.058255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774defd-1226-4325-a8cf-6c30e9681e7b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.059733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 514/1014] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:20.065028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5df66-7703-4cf6-b4a1-7181ed98769a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.065428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5df66-7703-4cf6-b4a1-7181ed98769a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.065682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5df66-7703-4cf6-b4a1-7181ed98769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.083403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-87b5df66-7703-4cf6-b4a1-7181ed98769a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:20.084566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-87b5df66-7703-4cf6-b4a1-7181ed98769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:20.155772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 501/1015] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:20 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:20.251547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2015e1-0449-4bde-912e-ff13df72a9bb None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.251872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2015e1-0449-4bde-912e-ff13df72a9bb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.252095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2015e1-0449-4bde-912e-ff13df72a9bb None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.253503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 515/1016] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:20.258624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcc17d-20cd-46d7-bd59-8b5b2ec7d033 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.258910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcc17d-20cd-46d7-bd59-8b5b2ec7d033 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.259180 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcc17d-20cd-46d7-bd59-8b5b2ec7d033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.277552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-49bcc17d-20cd-46d7-bd59-8b5b2ec7d033 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:20.278719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-49bcc17d-20cd-46d7-bd59-8b5b2ec7d033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:20.304817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.345071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345afbac-4048-47b1-ac6b-568c00a39dbb None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.345312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345afbac-4048-47b1-ac6b-568c00a39dbb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.345594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345afbac-4048-47b1-ac6b-568c00a39dbb None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.347027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 516/1017] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:20.351074 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 502/1018] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:20 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:20.351766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec59779-5e08-4ede-ab35-2504a0ad3c18 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.352046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec59779-5e08-4ede-ab35-2504a0ad3c18 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.352319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec59779-5e08-4ede-ab35-2504a0ad3c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.371943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8ec59779-5e08-4ede-ab35-2504a0ad3c18 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:20.373195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8ec59779-5e08-4ede-ab35-2504a0ad3c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:20.431400 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcc17d-20cd-46d7-bd59-8b5b2ec7d033 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.443510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 517/1019] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:20 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:20.535096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcc17d-20cd-46d7-bd59-8b5b2ec7d033 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.571132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec22677-c570-4b01-98fd-89f8dcad8521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.571924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec22677-c570-4b01-98fd-89f8dcad8521 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.572348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec22677-c570-4b01-98fd-89f8dcad8521 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.572766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec22677-c570-4b01-98fd-89f8dcad8521 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.573570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec22677-c570-4b01-98fd-89f8dcad8521 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:20.575089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec22677-c570-4b01-98fd-89f8dcad8521 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.628922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec59779-5e08-4ede-ab35-2504a0ad3c18 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.647123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.663728 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 503/1020] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:20 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:20.720364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec22677-c570-4b01-98fd-89f8dcad8521 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.738294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec59779-5e08-4ede-ab35-2504a0ad3c18 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.745160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.786921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2389c0-9c43-4a9c-a5ba-39ec3b6d1c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.787833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2389c0-9c43-4a9c-a5ba-39ec3b6d1c3b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.788253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2389c0-9c43-4a9c-a5ba-39ec3b6d1c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.788653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2389c0-9c43-4a9c-a5ba-39ec3b6d1c3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.801273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2389c0-9c43-4a9c-a5ba-39ec3b6d1c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-0f2389c0-9c43-4a9c-a5ba-39ec3b6d1c3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:20.807198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:20.808179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:20.809053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 518/1021] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:20.814285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2389c0-9c43-4a9c-a5ba-39ec3b6d1c3b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.838988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec22677-c570-4b01-98fd-89f8dcad8521 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.877686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3fa1-8def-4a4f-8ddf-13bb3dd57e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.878355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3fa1-8def-4a4f-8ddf-13bb3dd57e06 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.878603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3fa1-8def-4a4f-8ddf-13bb3dd57e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.878873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3fa1-8def-4a4f-8ddf-13bb3dd57e06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.880030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3fa1-8def-4a4f-8ddf-13bb3dd57e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:20.881391 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3fa1-8def-4a4f-8ddf-13bb3dd57e06 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.883176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 504/1022] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:20.888478 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3fa1-8def-4a4f-8ddf-13bb3dd57e06 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.892577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:20.924578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2389c0-9c43-4a9c-a5ba-39ec3b6d1c3b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:20.962894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f948fd8-8a99-4f9a-a8fd-5fb36d91c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:20.963502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f948fd8-8a99-4f9a-a8fd-5fb36d91c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:20.963781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f948fd8-8a99-4f9a-a8fd-5fb36d91c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:20.964049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f948fd8-8a99-4f9a-a8fd-5fb36d91c5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:20.964712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f948fd8-8a99-4f9a-a8fd-5fb36d91c5c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:20.965010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f948fd8-8a99-4f9a-a8fd-5fb36d91c5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:20.966416 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f948fd8-8a99-4f9a-a8fd-5fb36d91c5c3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:20.975403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 519/1023] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:20.981040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f948fd8-8a99-4f9a-a8fd-5fb36d91c5c3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:20.992707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.006279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3fa1-8def-4a4f-8ddf-13bb3dd57e06 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.047523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf54ba7-8939-42b8-9ea9-d7408b657157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.048128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf54ba7-8939-42b8-9ea9-d7408b657157 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.048533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf54ba7-8939-42b8-9ea9-d7408b657157 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.048806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf54ba7-8939-42b8-9ea9-d7408b657157 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.049631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf54ba7-8939-42b8-9ea9-d7408b657157 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.051638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf54ba7-8939-42b8-9ea9-d7408b657157 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.098087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f948fd8-8a99-4f9a-a8fd-5fb36d91c5c3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.130725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8291feb-5242-425f-ac34-fd99ad709f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.131269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8291feb-5242-425f-ac34-fd99ad709f77 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.131544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8291feb-5242-425f-ac34-fd99ad709f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.131816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8291feb-5242-425f-ac34-fd99ad709f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.133719 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.144898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8291feb-5242-425f-ac34-fd99ad709f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.146397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8291feb-5242-425f-ac34-fd99ad709f77 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.157332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 505/1024] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:20 2022] POST /identity/v3/projects => generated 311 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f8291feb-5242-425f-ac34-fd99ad709f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:21.162880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.163920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:21.164855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:21.164855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:21.164855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:21.164855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 520/1025] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:21.170373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf54ba7-8939-42b8-9ea9-d7408b657157 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.283514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf54ba7-8939-42b8-9ea9-d7408b657157 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.325398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410550c-0af5-4dfc-917b-d58fa63904fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.326037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410550c-0af5-4dfc-917b-d58fa63904fb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.326320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410550c-0af5-4dfc-917b-d58fa63904fb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.326591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410550c-0af5-4dfc-917b-d58fa63904fb None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.327234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410550c-0af5-4dfc-917b-d58fa63904fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:21.327531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410550c-0af5-4dfc-917b-d58fa63904fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.329595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410550c-0af5-4dfc-917b-d58fa63904fb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.340171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.345494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 506/1026] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:21.348676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8291feb-5242-425f-ac34-fd99ad709f77 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.463087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8291feb-5242-425f-ac34-fd99ad709f77 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.496802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900ee44-84b4-4985-be43-5910f552c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.497425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900ee44-84b4-4985-be43-5910f552c3cb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.497728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900ee44-84b4-4985-be43-5910f552c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.497999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900ee44-84b4-4985-be43-5910f552c3cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.506759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900ee44-84b4-4985-be43-5910f552c3cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.508197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900ee44-84b4-4985-be43-5910f552c3cb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-3900ee44-84b4-4985-be43-5910f552c3cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:21.520611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:21.521863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:21.522827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 521/1027] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:21.530703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410550c-0af5-4dfc-917b-d58fa63904fb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.635254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410550c-0af5-4dfc-917b-d58fa63904fb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.674044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9658f88-f8a4-4f2c-bbbd-9b9abcf2d2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.674654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9658f88-f8a4-4f2c-bbbd-9b9abcf2d2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.674932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9658f88-f8a4-4f2c-bbbd-9b9abcf2d2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.675201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9658f88-f8a4-4f2c-bbbd-9b9abcf2d2e7 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.675929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9658f88-f8a4-4f2c-bbbd-9b9abcf2d2e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:21.676230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9658f88-f8a4-4f2c-bbbd-9b9abcf2d2e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.677667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9658f88-f8a4-4f2c-bbbd-9b9abcf2d2e7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.696501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 507/1028] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:21.701991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900ee44-84b4-4985-be43-5910f552c3cb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:21.755373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:21.812151 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900ee44-84b4-4985-be43-5910f552c3cb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:21.847745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be370b94-1ae2-4220-9de1-3e4243a98b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:21.848435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be370b94-1ae2-4220-9de1-3e4243a98b25 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:21.848778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be370b94-1ae2-4220-9de1-3e4243a98b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:21.849115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be370b94-1ae2-4220-9de1-3e4243a98b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:21.918030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be370b94-1ae2-4220-9de1-3e4243a98b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:21.919556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be370b94-1ae2-4220-9de1-3e4243a98b25 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:21.965304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.025656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 522/1029] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:22.027431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9658f88-f8a4-4f2c-bbbd-9b9abcf2d2e7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.089116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.132712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9658f88-f8a4-4f2c-bbbd-9b9abcf2d2e7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.167101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c022e-de29-4bd2-b1f6-3086b1f98dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.167837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c022e-de29-4bd2-b1f6-3086b1f98dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.168066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c022e-de29-4bd2-b1f6-3086b1f98dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.168271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c022e-de29-4bd2-b1f6-3086b1f98dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.179475 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c022e-de29-4bd2-b1f6-3086b1f98dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.180907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c022e-de29-4bd2-b1f6-3086b1f98dc0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-075c022e-de29-4bd2-b1f6-3086b1f98dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:22.195473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:22.196464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:22.197390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:22.197390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:22.197390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:22.197390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 508/1030] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:22.202198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be370b94-1ae2-4220-9de1-3e4243a98b25 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.308839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be370b94-1ae2-4220-9de1-3e4243a98b25 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.345426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d22a9b-40ef-4305-a91a-fd63773fc062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.346054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d22a9b-40ef-4305-a91a-fd63773fc062 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.346333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d22a9b-40ef-4305-a91a-fd63773fc062 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.351691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d22a9b-40ef-4305-a91a-fd63773fc062 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.351691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d22a9b-40ef-4305-a91a-fd63773fc062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.351691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d22a9b-40ef-4305-a91a-fd63773fc062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.351691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d22a9b-40ef-4305-a91a-fd63773fc062 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.364853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 523/1031] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:22.366626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c022e-de29-4bd2-b1f6-3086b1f98dc0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.470500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c022e-de29-4bd2-b1f6-3086b1f98dc0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.480855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.504934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f130639-2317-4de9-be35-686d4bfcff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.505604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f130639-2317-4de9-be35-686d4bfcff99 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.505881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f130639-2317-4de9-be35-686d4bfcff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.506218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f130639-2317-4de9-be35-686d4bfcff99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.512592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f130639-2317-4de9-be35-686d4bfcff99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.514057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f130639-2317-4de9-be35-686d4bfcff99 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-5f130639-2317-4de9-be35-686d4bfcff99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:22.525390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:22.526526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:22.527669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:22.527669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:22.527669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:22.527669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:22.527669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:22.527669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:22.527669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:22.527669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:22.535396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 509/1032] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:22.536509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d22a9b-40ef-4305-a91a-fd63773fc062 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.546122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.616760 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca2dee-5ceb-4176-bad9-6413858c91e5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.617057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca2dee-5ceb-4176-bad9-6413858c91e5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.617226 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca2dee-5ceb-4176-bad9-6413858c91e5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.621526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 510/1033] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:22.623656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c21a1c-9662-427b-91a5-901b1e7825d9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.623936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c21a1c-9662-427b-91a5-901b1e7825d9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.624202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c21a1c-9662-427b-91a5-901b1e7825d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.643459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-81c21a1c-9662-427b-91a5-901b1e7825d9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:22.644644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-81c21a1c-9662-427b-91a5-901b1e7825d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:22.645244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d22a9b-40ef-4305-a91a-fd63773fc062 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.683488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747f29d-402c-45ef-b818-293b4c13fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.684200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747f29d-402c-45ef-b818-293b4c13fa38 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.684472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747f29d-402c-45ef-b818-293b4c13fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.684845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747f29d-402c-45ef-b818-293b4c13fa38 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.685569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747f29d-402c-45ef-b818-293b4c13fa38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.685867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747f29d-402c-45ef-b818-293b4c13fa38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.687277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747f29d-402c-45ef-b818-293b4c13fa38 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.699988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 524/1034] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:22.706789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747f29d-402c-45ef-b818-293b4c13fa38 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:22.733491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 511/1035] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:22.774724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:22.809033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747f29d-402c-45ef-b818-293b4c13fa38 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:22.844225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e113-5c9d-40eb-b159-e8ac9bd55f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:22.844829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e113-5c9d-40eb-b159-e8ac9bd55f02 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:22.845100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e113-5c9d-40eb-b159-e8ac9bd55f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:22.845364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e113-5c9d-40eb-b159-e8ac9bd55f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:22.846113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e113-5c9d-40eb-b159-e8ac9bd55f02 None admin] RBAC: Adding query filter params (role.id=77f77a268f804d579d79685e961299d2, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=6ef753445d864a0ab30ec970446b29cd) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:22.846415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e113-5c9d-40eb-b159-e8ac9bd55f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:22.847832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e113-5c9d-40eb-b159-e8ac9bd55f02 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:22.861792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 525/1036] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:22 2022] GET /identity/v3/role_assignments?user.id=6ef753445d864a0ab30ec970446b29cd&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=77f77a268f804d579d79685e961299d2 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:23.003545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c21a1c-9662-427b-91a5-901b1e7825d9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.102802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.106325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c21a1c-9662-427b-91a5-901b1e7825d9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.128997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a48702-1b07-4a54-8587-99f0f71b2f23 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.129283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a48702-1b07-4a54-8587-99f0f71b2f23 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.129580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a48702-1b07-4a54-8587-99f0f71b2f23 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.130917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 526/1037] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:23.135825 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb9d8-6938-4164-af9b-266cf27c3515 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.136105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb9d8-6938-4164-af9b-266cf27c3515 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.136373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb9d8-6938-4164-af9b-266cf27c3515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.143554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff318d91-cea1-47a1-aaf9-99872da9cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.144193 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318d91-cea1-47a1-aaf9-99872da9cee5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.144467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318d91-cea1-47a1-aaf9-99872da9cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.144733 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318d91-cea1-47a1-aaf9-99872da9cee5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.145312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff318d91-cea1-47a1-aaf9-99872da9cee5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.146709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff318d91-cea1-47a1-aaf9-99872da9cee5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.155185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f7dbb9d8-6938-4164-af9b-266cf27c3515 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:23.157355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f7dbb9d8-6938-4164-af9b-266cf27c3515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ff318d91-cea1-47a1-aaf9-99872da9cee5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:23.157537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:23.158688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:45:23.160011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:23.161637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 512/1038] 10.222.0.58 () {56 vars in 1105 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:23.164820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff318d91-cea1-47a1-aaf9-99872da9cee5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.233142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 527/1039] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:23.272703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff318d91-cea1-47a1-aaf9-99872da9cee5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.308006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46c07-9ce9-42a4-a719-7212f45c1041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.308613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46c07-9ce9-42a4-a719-7212f45c1041 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.308889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46c07-9ce9-42a4-a719-7212f45c1041 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.309160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46c07-9ce9-42a4-a719-7212f45c1041 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.309814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef46c07-9ce9-42a4-a719-7212f45c1041 None admin] RBAC: Adding query filter params (name=image) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:23.310114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef46c07-9ce9-42a4-a719-7212f45c1041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.311463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef46c07-9ce9-42a4-a719-7212f45c1041 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.317136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 513/1040] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:23.322765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb9d8-6938-4164-af9b-266cf27c3515 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.390131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.431020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb9d8-6938-4164-af9b-266cf27c3515 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.464692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b59ce-47b5-44a3-918b-f461f32fe637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.465298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b59ce-47b5-44a3-918b-f461f32fe637 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.465604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b59ce-47b5-44a3-918b-f461f32fe637 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.465878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b59ce-47b5-44a3-918b-f461f32fe637 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.466506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b59ce-47b5-44a3-918b-f461f32fe637 None admin] RBAC: Adding query filter params (type=image) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:23.466805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b59ce-47b5-44a3-918b-f461f32fe637 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.468167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b59ce-47b5-44a3-918b-f461f32fe637 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.473786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 528/1041] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:23.479481 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46c07-9ce9-42a4-a719-7212f45c1041 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.507986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.511155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b59ce-47b5-44a3-918b-f461f32fe637 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.582580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46c07-9ce9-42a4-a719-7212f45c1041 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.615797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b59ce-47b5-44a3-918b-f461f32fe637 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.616357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd9382-e44f-4c8a-a2e8-8010ce8239f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.616962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd9382-e44f-4c8a-a2e8-8010ce8239f5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.617399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd9382-e44f-4c8a-a2e8-8010ce8239f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.617695 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd9382-e44f-4c8a-a2e8-8010ce8239f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.619153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd9382-e44f-4c8a-a2e8-8010ce8239f5 None admin] RBAC: Adding query filter params (interface=public, service_id=ed6fe88577dd4c209cad7efbaaf2a9fb, region_id=RegionOne) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:23.619463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd9382-e44f-4c8a-a2e8-8010ce8239f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.620822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd9382-e44f-4c8a-a2e8-8010ce8239f5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.627358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 514/1042] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/endpoints?service_id=ed6fe88577dd4c209cad7efbaaf2a9fb&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:23.632395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd9382-e44f-4c8a-a2e8-8010ce8239f5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.643534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.654169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347457c-0352-492b-8c02-d6010dcfc276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.656449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347457c-0352-492b-8c02-d6010dcfc276 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.656449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347457c-0352-492b-8c02-d6010dcfc276 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.656449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347457c-0352-492b-8c02-d6010dcfc276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.656449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347457c-0352-492b-8c02-d6010dcfc276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.657998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347457c-0352-492b-8c02-d6010dcfc276 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.659833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 529/1043] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:23.665996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347457c-0352-492b-8c02-d6010dcfc276 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:23.731840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:23.743107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd9382-e44f-4c8a-a2e8-8010ce8239f5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.778809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347457c-0352-492b-8c02-d6010dcfc276 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:23.781903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830f0c-c809-4a3e-9d03-4f94e3193427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.782443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830f0c-c809-4a3e-9d03-4f94e3193427 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.782724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830f0c-c809-4a3e-9d03-4f94e3193427 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.782995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830f0c-c809-4a3e-9d03-4f94e3193427 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.783606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830f0c-c809-4a3e-9d03-4f94e3193427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.785217 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830f0c-c809-4a3e-9d03-4f94e3193427 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.801498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 515/1044] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 07:45:23 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:45:23.819738 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c3317-e192-414f-a700-45d8ea4ce4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:23.820481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c3317-e192-414f-a700-45d8ea4ce4a9 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:23.820852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c3317-e192-414f-a700-45d8ea4ce4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:23.821196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c3317-e192-414f-a700-45d8ea4ce4a9 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:23.821979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c3317-e192-414f-a700-45d8ea4ce4a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:23.823538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c3317-e192-414f-a700-45d8ea4ce4a9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:23.954780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 530/1045] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:45:23 2022] POST /identity/v3/users => generated 285 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:24.747450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ff4df-cc94-48fd-ada8-6ad62896105c None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.747953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ff4df-cc94-48fd-ada8-6ad62896105c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.747953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ff4df-cc94-48fd-ada8-6ad62896105c None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.749265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 516/1046] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:24.755008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26383eff-39f8-4cf3-aa27-9d80e8903ce4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:24.755433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26383eff-39f8-4cf3-aa27-9d80e8903ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:24.755605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26383eff-39f8-4cf3-aa27-9d80e8903ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:24.774190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-26383eff-39f8-4cf3-aa27-9d80e8903ce4 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:24.775360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26383eff-39f8-4cf3-aa27-9d80e8903ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:24.821191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:24.843804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 531/1047] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:25.112599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ff4df-cc94-48fd-ada8-6ad62896105c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.212692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ff4df-cc94-48fd-ada8-6ad62896105c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.246132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ee58-999f-423d-b5bc-deee61996a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.246752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ee58-999f-423d-b5bc-deee61996a53 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.247022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ee58-999f-423d-b5bc-deee61996a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.247288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ee58-999f-423d-b5bc-deee61996a53 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.257736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ee58-999f-423d-b5bc-deee61996a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-2fe0ee58-999f-423d-b5bc-deee61996a53 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:25.262352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:25.263270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:25.264114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:25.265804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 517/1048] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:25.269436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26383eff-39f8-4cf3-aa27-9d80e8903ce4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.378328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26383eff-39f8-4cf3-aa27-9d80e8903ce4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.412877 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158fa6-6d97-44d9-8947-4d238d3972c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.413506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158fa6-6d97-44d9-8947-4d238d3972c8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.413780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158fa6-6d97-44d9-8947-4d238d3972c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.414260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158fa6-6d97-44d9-8947-4d238d3972c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.415071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03158fa6-6d97-44d9-8947-4d238d3972c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:25.415368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03158fa6-6d97-44d9-8947-4d238d3972c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.416951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03158fa6-6d97-44d9-8947-4d238d3972c8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.431073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 532/1049] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:25.432392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ee58-999f-423d-b5bc-deee61996a53 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.452109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.535476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ee58-999f-423d-b5bc-deee61996a53 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.568747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a84e3c-9174-40ec-bc71-10711870f4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.569371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a84e3c-9174-40ec-bc71-10711870f4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.569668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a84e3c-9174-40ec-bc71-10711870f4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.569938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a84e3c-9174-40ec-bc71-10711870f4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.580461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a84e3c-9174-40ec-bc71-10711870f4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.581924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a84e3c-9174-40ec-bc71-10711870f4d1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-58a84e3c-9174-40ec-bc71-10711870f4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:25.596407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:25.597392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:25.598369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:25.598369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:25.598369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:25.601785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 518/1050] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:25.603248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158fa6-6d97-44d9-8947-4d238d3972c8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.647715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.705699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158fa6-6d97-44d9-8947-4d238d3972c8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.739054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e001f9e-6e68-4576-87c1-2e44356496f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.739659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e001f9e-6e68-4576-87c1-2e44356496f6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.739938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e001f9e-6e68-4576-87c1-2e44356496f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.740205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e001f9e-6e68-4576-87c1-2e44356496f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.740922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e001f9e-6e68-4576-87c1-2e44356496f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:25.741222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e001f9e-6e68-4576-87c1-2e44356496f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.742601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e001f9e-6e68-4576-87c1-2e44356496f6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.750718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0fa99-00f4-4a7a-a668-6b8d5d19bb97 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.751185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0fa99-00f4-4a7a-a668-6b8d5d19bb97 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.751287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0fa99-00f4-4a7a-a668-6b8d5d19bb97 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.752730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 519/1051] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:25.759558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 533/1052] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:25.759978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78173c5-904f-4097-ae58-b3e30f3639ed None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.759978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78173c5-904f-4097-ae58-b3e30f3639ed None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.759978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78173c5-904f-4097-ae58-b3e30f3639ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.760498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e001f9e-6e68-4576-87c1-2e44356496f6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.777350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b78173c5-904f-4097-ae58-b3e30f3639ed None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:25.778703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b78173c5-904f-4097-ae58-b3e30f3639ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:25.863175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.863725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:25.866554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e001f9e-6e68-4576-87c1-2e44356496f6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:25.869853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 520/1053] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:25.900806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e0785-e477-4f93-9005-e4168c00db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:25.901946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0785-e477-4f93-9005-e4168c00db1e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.902747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0785-e477-4f93-9005-e4168c00db1e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.903018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0785-e477-4f93-9005-e4168c00db1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.910683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e0785-e477-4f93-9005-e4168c00db1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:25.912102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e0785-e477-4f93-9005-e4168c00db1e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7e5e0785-e477-4f93-9005-e4168c00db1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:25.923493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:25.924451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:25.925568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 534/1054] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:25.930280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78173c5-904f-4097-ae58-b3e30f3639ed None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:25.935730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b880eb-48a5-4253-b4e6-a9dc201998c2 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.935988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b880eb-48a5-4253-b4e6-a9dc201998c2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.936260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b880eb-48a5-4253-b4e6-a9dc201998c2 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.938580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 535/1055] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:45:25.943852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62158-2f8a-4505-a56e-b106e1b57069 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:25.944138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62158-2f8a-4505-a56e-b106e1b57069 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:25.944414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62158-2f8a-4505-a56e-b106e1b57069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:25.964139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4db62158-2f8a-4505-a56e-b106e1b57069 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:25.966282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4db62158-2f8a-4505-a56e-b106e1b57069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:26.038684 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 536/1056] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:26.039960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78173c5-904f-4097-ae58-b3e30f3639ed None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.075676 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445d538-905e-484c-ba7d-b14656c2f00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.076285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445d538-905e-484c-ba7d-b14656c2f00e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.076562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445d538-905e-484c-ba7d-b14656c2f00e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.076830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445d538-905e-484c-ba7d-b14656c2f00e None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.077579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445d538-905e-484c-ba7d-b14656c2f00e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:26.078445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445d538-905e-484c-ba7d-b14656c2f00e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.079867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445d538-905e-484c-ba7d-b14656c2f00e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.102185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 521/1057] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 07:45:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:26.103421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db62158-2f8a-4505-a56e-b106e1b57069 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.139851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445d538-905e-484c-ba7d-b14656c2f00e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.198922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.202568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.212798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db62158-2f8a-4505-a56e-b106e1b57069 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.243585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445d538-905e-484c-ba7d-b14656c2f00e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.247874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768b1e3-090f-4caf-a40f-17c4426d83a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.248497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b1e3-090f-4caf-a40f-17c4426d83a5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.248767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b1e3-090f-4caf-a40f-17c4426d83a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.249030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b1e3-090f-4caf-a40f-17c4426d83a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.259309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768b1e3-090f-4caf-a40f-17c4426d83a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.260734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768b1e3-090f-4caf-a40f-17c4426d83a5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-0768b1e3-090f-4caf-a40f-17c4426d83a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:26.276533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:26.277526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:26.278435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:26.278435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:26.278435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:26.280071 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b730dd-fa19-42b1-a7e5-1ff3796bf516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.280707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b730dd-fa19-42b1-a7e5-1ff3796bf516 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.281007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b730dd-fa19-42b1-a7e5-1ff3796bf516 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.281822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b730dd-fa19-42b1-a7e5-1ff3796bf516 None admin] PATH_INFO: `/v3/services/image` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.282404 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b730dd-fa19-42b1-a7e5-1ff3796bf516 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.283515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 537/1058] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:26.283909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b730dd-fa19-42b1-a7e5-1ff3796bf516 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.284627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768b1e3-090f-4caf-a40f-17c4426d83a5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d7b730dd-fa19-42b1-a7e5-1ff3796bf516 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:26.294077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:26.297736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:26.298891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 522/1059] 10.222.0.58 () {56 vars in 1105 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:26.301357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b730dd-fa19-42b1-a7e5-1ff3796bf516 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.390271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768b1e3-090f-4caf-a40f-17c4426d83a5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.405881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b730dd-fa19-42b1-a7e5-1ff3796bf516 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.425115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131dd8d-b874-4575-931d-0ab4133ed2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.426022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131dd8d-b874-4575-931d-0ab4133ed2cb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.426139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.426230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131dd8d-b874-4575-931d-0ab4133ed2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.426339 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131dd8d-b874-4575-931d-0ab4133ed2cb None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.426913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131dd8d-b874-4575-931d-0ab4133ed2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:26.427212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131dd8d-b874-4575-931d-0ab4133ed2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.428573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131dd8d-b874-4575-931d-0ab4133ed2cb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.439417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e880f-2228-40e3-a351-0b970f9501f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.441630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e880f-2228-40e3-a351-0b970f9501f9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.441766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 538/1060] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:26.441883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e880f-2228-40e3-a351-0b970f9501f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.441883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e880f-2228-40e3-a351-0b970f9501f9 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.442031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131dd8d-b874-4575-931d-0ab4133ed2cb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.442110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e880f-2228-40e3-a351-0b970f9501f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:26.442110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e880f-2228-40e3-a351-0b970f9501f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.442799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e880f-2228-40e3-a351-0b970f9501f9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.444352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.447818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 523/1061] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:26.448468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e880f-2228-40e3-a351-0b970f9501f9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.546477 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131dd8d-b874-4575-931d-0ab4133ed2cb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.547834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e880f-2228-40e3-a351-0b970f9501f9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.581366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626de5e-daf4-4576-b43a-60c024de6084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.582014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626de5e-daf4-4576-b43a-60c024de6084 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.582288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626de5e-daf4-4576-b43a-60c024de6084 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.582556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626de5e-daf4-4576-b43a-60c024de6084 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.582803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c520b6b-3d30-459a-ad45-512fe139e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.583422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c520b6b-3d30-459a-ad45-512fe139e0cf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.583696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c520b6b-3d30-459a-ad45-512fe139e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.583961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c520b6b-3d30-459a-ad45-512fe139e0cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.589031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626de5e-daf4-4576-b43a-60c024de6084 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.590478 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626de5e-daf4-4576-b43a-60c024de6084 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.594098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c520b6b-3d30-459a-ad45-512fe139e0cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4c520b6b-3d30-459a-ad45-512fe139e0cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:26.598771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:26.599714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:26.600577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 539/1062] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:26.601293 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c520b6b-3d30-459a-ad45-512fe139e0cf None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-e626de5e-daf4-4576-b43a-60c024de6084 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:26.601363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:26.602296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:26.603203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:26.603203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:26.603203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:26.603203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:26.603203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:26.603203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:26.603203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:26.603203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:26.603203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 524/1063] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:26.605703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626de5e-daf4-4576-b43a-60c024de6084 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.650707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.665835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.703599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c520b6b-3d30-459a-ad45-512fe139e0cf None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.706499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626de5e-daf4-4576-b43a-60c024de6084 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.737581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8535a-619e-4588-afcf-61101aa88cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.738175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8535a-619e-4588-afcf-61101aa88cab None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.738448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8535a-619e-4588-afcf-61101aa88cab None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.738770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8535a-619e-4588-afcf-61101aa88cab None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.739335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8535a-619e-4588-afcf-61101aa88cab None admin] RBAC: Adding query filter params (type=image) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:26.739439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b3cfe-9ed4-4e37-adc2-7d9b61be553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.739633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8535a-619e-4588-afcf-61101aa88cab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.739925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b3cfe-9ed4-4e37-adc2-7d9b61be553c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.740196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b3cfe-9ed4-4e37-adc2-7d9b61be553c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.740461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b3cfe-9ed4-4e37-adc2-7d9b61be553c None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.740978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8535a-619e-4588-afcf-61101aa88cab None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.741108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b3cfe-9ed4-4e37-adc2-7d9b61be553c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:26.741429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b3cfe-9ed4-4e37-adc2-7d9b61be553c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.743001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b3cfe-9ed4-4e37-adc2-7d9b61be553c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.751648 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 540/1064] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:26.751648 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8535a-619e-4588-afcf-61101aa88cab None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.752015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 525/1065] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:26.752752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b3cfe-9ed4-4e37-adc2-7d9b61be553c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.849226 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8535a-619e-4588-afcf-61101aa88cab None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.849795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b3cfe-9ed4-4e37-adc2-7d9b61be553c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:26.857152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.875887 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:26.883622 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4bdc0-4641-4248-bb7e-e8d5f2049618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.884222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4bdc0-4641-4248-bb7e-e8d5f2049618 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.884428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa505-ad72-4a54-95ed-6e188c4451bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:26.884548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4bdc0-4641-4248-bb7e-e8d5f2049618 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.884750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4bdc0-4641-4248-bb7e-e8d5f2049618 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.885019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa505-ad72-4a54-95ed-6e188c4451bd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:26.885290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa505-ad72-4a54-95ed-6e188c4451bd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:26.885381 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4bdc0-4641-4248-bb7e-e8d5f2049618 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.885584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa505-ad72-4a54-95ed-6e188c4451bd None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:26.886264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fa505-ad72-4a54-95ed-6e188c4451bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:26.886561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fa505-ad72-4a54-95ed-6e188c4451bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:26.886759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4bdc0-4641-4248-bb7e-e8d5f2049618 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.888002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fa505-ad72-4a54-95ed-6e188c4451bd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:26.899710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 541/1066] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:26.900472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa505-ad72-4a54-95ed-6e188c4451bd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:26.993495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 526/1067] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:45:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:26.993495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4bdc0-4641-4248-bb7e-e8d5f2049618 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.003488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa505-ad72-4a54-95ed-6e188c4451bd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.051584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42490c-f336-4452-b194-74f105d35707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.052232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42490c-f336-4452-b194-74f105d35707 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.052508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42490c-f336-4452-b194-74f105d35707 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.052773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42490c-f336-4452-b194-74f105d35707 None admin] PATH_INFO: `/v3/users/bdc795cddbe74d6481640630582f5427` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.068948 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42490c-f336-4452-b194-74f105d35707 None admin] RBAC: Authorizing `identity:get_user(user_id=bdc795cddbe74d6481640630582f5427)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.070452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42490c-f336-4452-b194-74f105d35707 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.072330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 542/1068] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:26 2022] GET /identity/v3/users/bdc795cddbe74d6481640630582f5427 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:27.078949 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42490c-f336-4452-b194-74f105d35707 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.115990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4bdc0-4641-4248-bb7e-e8d5f2049618 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.125284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:27.153834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaf2b6-dce9-4d08-a90d-2d6554dedfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.154495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaf2b6-dce9-4d08-a90d-2d6554dedfdd None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.154773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaf2b6-dce9-4d08-a90d-2d6554dedfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.155106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaf2b6-dce9-4d08-a90d-2d6554dedfdd None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/6ef753445d864a0ab30ec970446b29cd/roles/77f77a268f804d579d79685e961299d2` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.159299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaf2b6-dce9-4d08-a90d-2d6554dedfdd None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=6ef753445d864a0ab30ec970446b29cd, role_id=77f77a268f804d579d79685e961299d2)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.160726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaf2b6-dce9-4d08-a90d-2d6554dedfdd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.188451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42490c-f336-4452-b194-74f105d35707 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.216780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 527/1069] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:26 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/6ef753445d864a0ab30ec970446b29cd/roles/77f77a268f804d579d79685e961299d2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:27.225867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80d5f1-5b4d-4312-9355-b78547ba9376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.226503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80d5f1-5b4d-4312-9355-b78547ba9376 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.226783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80d5f1-5b4d-4312-9355-b78547ba9376 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.227055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80d5f1-5b4d-4312-9355-b78547ba9376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.305214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80d5f1-5b4d-4312-9355-b78547ba9376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.306750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80d5f1-5b4d-4312-9355-b78547ba9376 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.358413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:27.424495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 543/1070] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:45:27.430449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaf2b6-dce9-4d08-a90d-2d6554dedfdd None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.456774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:27.534809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaf2b6-dce9-4d08-a90d-2d6554dedfdd None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.568763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c4dd6-c1a6-4b17-b40a-1fcb3a482210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.569389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c4dd6-c1a6-4b17-b40a-1fcb3a482210 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.569690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c4dd6-c1a6-4b17-b40a-1fcb3a482210 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.569956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c4dd6-c1a6-4b17-b40a-1fcb3a482210 None admin] PATH_INFO: `/v3/projects/a4162287dec44feba447d5b1eea66e69` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.571067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c4dd6-c1a6-4b17-b40a-1fcb3a482210 None admin] RBAC: Authorizing `identity:get_project(project_id=a4162287dec44feba447d5b1eea66e69)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.572479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c4dd6-c1a6-4b17-b40a-1fcb3a482210 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.574302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 528/1071] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/projects/a4162287dec44feba447d5b1eea66e69 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:27.580802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80d5f1-5b4d-4312-9355-b78547ba9376 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:27.679695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80d5f1-5b4d-4312-9355-b78547ba9376 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:27.713635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864c25b-4778-4880-bd1b-02030aa11c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:27.714235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864c25b-4778-4880-bd1b-02030aa11c79 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:27.714507 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864c25b-4778-4880-bd1b-02030aa11c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:27.714770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864c25b-4778-4880-bd1b-02030aa11c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:27.715487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864c25b-4778-4880-bd1b-02030aa11c79 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=a4162287dec44feba447d5b1eea66e69, user.id=bdc795cddbe74d6481640630582f5427) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:27.715787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864c25b-4778-4880-bd1b-02030aa11c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:27.717196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864c25b-4778-4880-bd1b-02030aa11c79 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:27.729492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 544/1072] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:27 2022] GET /identity/v3/role_assignments?user.id=bdc795cddbe74d6481640630582f5427&scope.project.id=a4162287dec44feba447d5b1eea66e69&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:28.949763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527797c6-a333-4bb5-a55b-58b33c259631 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.950313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527797c6-a333-4bb5-a55b-58b33c259631 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.950313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527797c6-a333-4bb5-a55b-58b33c259631 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.951664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 529/1073] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:28.957090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2e5c-c128-4df5-90c8-31ddfdf5de8a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:28.957577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2e5c-c128-4df5-90c8-31ddfdf5de8a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:28.957686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2e5c-c128-4df5-90c8-31ddfdf5de8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:28.965073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.977300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7c9a2e5c-c128-4df5-90c8-31ddfdf5de8a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:28.978521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7c9a2e5c-c128-4df5-90c8-31ddfdf5de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:29.058388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 545/1074] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:45:29.152503 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad3a86-f554-4d12-88aa-034923134c66 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.152853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad3a86-f554-4d12-88aa-034923134c66 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.153052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad3a86-f554-4d12-88aa-034923134c66 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.154593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 530/1075] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:29.160373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d348620-f77f-4190-849d-81d9bc6bb811 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.160664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d348620-f77f-4190-849d-81d9bc6bb811 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.160940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d348620-f77f-4190-849d-81d9bc6bb811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.179607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5d348620-f77f-4190-849d-81d9bc6bb811 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:29.180805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5d348620-f77f-4190-849d-81d9bc6bb811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:29.250374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 546/1076] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:29.332740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad3a86-f554-4d12-88aa-034923134c66 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.434587 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.444985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad3a86-f554-4d12-88aa-034923134c66 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.481091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84532df-465b-47a7-b230-10f68b2dbb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.481738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84532df-465b-47a7-b230-10f68b2dbb29 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.482014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84532df-465b-47a7-b230-10f68b2dbb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.482283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84532df-465b-47a7-b230-10f68b2dbb29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.521643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d348620-f77f-4190-849d-81d9bc6bb811 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.554968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84532df-465b-47a7-b230-10f68b2dbb29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:29.556786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84532df-465b-47a7-b230-10f68b2dbb29 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:29.587815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.625237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d348620-f77f-4190-849d-81d9bc6bb811 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.653318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.661612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7a701-2d06-4621-9669-0bda11b34348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.662246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a701-2d06-4621-9669-0bda11b34348 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.662527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a701-2d06-4621-9669-0bda11b34348 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.662797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a701-2d06-4621-9669-0bda11b34348 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.665108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 531/1077] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:29.666377 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68447520-5245-413f-ad21-409aa57195f9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.666652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68447520-5245-413f-ad21-409aa57195f9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.666916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68447520-5245-413f-ad21-409aa57195f9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.668145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 532/1078] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:29.671041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68447520-5245-413f-ad21-409aa57195f9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.680366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7a701-2d06-4621-9669-0bda11b34348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f3f7a701-2d06-4621-9669-0bda11b34348 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:29.685142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:29.686313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 547/1079] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:29.688179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6457d3b-62d7-42f5-bc04-ddf275b33468 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.689155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6457d3b-62d7-42f5-bc04-ddf275b33468 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.689155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6457d3b-62d7-42f5-bc04-ddf275b33468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.706824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c6457d3b-62d7-42f5-bc04-ddf275b33468 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:29.708011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c6457d3b-62d7-42f5-bc04-ddf275b33468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:29.774765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 548/1080] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:29.775513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6457d3b-62d7-42f5-bc04-ddf275b33468 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.778199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68447520-5245-413f-ad21-409aa57195f9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.818523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2f122-ada6-458f-ab3b-26971d5080c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.819154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f122-ada6-458f-ab3b-26971d5080c2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.819429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f122-ada6-458f-ab3b-26971d5080c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.819702 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f122-ada6-458f-ab3b-26971d5080c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.831599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2f122-ada6-458f-ab3b-26971d5080c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:29.833013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2f122-ada6-458f-ab3b-26971d5080c2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:29.834936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-2db2f122-ada6-458f-ab3b-26971d5080c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:29.848585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:29.854035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:29.855160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:29.855160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:29.855160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:29.855160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 533/1081] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:29.856491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2f122-ada6-458f-ab3b-26971d5080c2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.885814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6457d3b-62d7-42f5-bc04-ddf275b33468 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:29.902767 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:29.925655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ec08-f379-4ae8-a46a-7dd85440e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:29.926255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ec08-f379-4ae8-a46a-7dd85440e058 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:29.926529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ec08-f379-4ae8-a46a-7dd85440e058 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:29.926800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ec08-f379-4ae8-a46a-7dd85440e058 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:29.927453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660ec08-f379-4ae8-a46a-7dd85440e058 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:29.927748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660ec08-f379-4ae8-a46a-7dd85440e058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:29.929100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660ec08-f379-4ae8-a46a-7dd85440e058 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:29.941516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 549/1082] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:29.943771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ec08-f379-4ae8-a46a-7dd85440e058 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:29.967451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2f122-ada6-458f-ab3b-26971d5080c2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.005097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6aadb-992c-4c56-b406-efb33af9e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.005878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6aadb-992c-4c56-b406-efb33af9e30d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.006150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6aadb-992c-4c56-b406-efb33af9e30d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.006416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6aadb-992c-4c56-b406-efb33af9e30d None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.007172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6aadb-992c-4c56-b406-efb33af9e30d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:30.007471 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6aadb-992c-4c56-b406-efb33af9e30d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.008957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6aadb-992c-4c56-b406-efb33af9e30d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.033581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 534/1083] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:30.049194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6aadb-992c-4c56-b406-efb33af9e30d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.064571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ec08-f379-4ae8-a46a-7dd85440e058 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.084434 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.105188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1f0f1-f5d4-458b-93a3-28b7fb3feae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.105872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f0f1-f5d4-458b-93a3-28b7fb3feae0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.106145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f0f1-f5d4-458b-93a3-28b7fb3feae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.106409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f0f1-f5d4-458b-93a3-28b7fb3feae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.117354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1f0f1-f5d4-458b-93a3-28b7fb3feae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.119499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1f0f1-f5d4-458b-93a3-28b7fb3feae0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-54a1f0f1-f5d4-458b-93a3-28b7fb3feae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:30.137130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:30.138278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:30.139176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:30.139176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:30.139176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:30.142177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 550/1084] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:30.147642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1f0f1-f5d4-458b-93a3-28b7fb3feae0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.173335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6aadb-992c-4c56-b406-efb33af9e30d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.175788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.219786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f59bd8-f9f3-4b98-b9ca-dbf395693a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.220415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f59bd8-f9f3-4b98-b9ca-dbf395693a0d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.220689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f59bd8-f9f3-4b98-b9ca-dbf395693a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.220953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f59bd8-f9f3-4b98-b9ca-dbf395693a0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.233162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f59bd8-f9f3-4b98-b9ca-dbf395693a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f4f59bd8-f9f3-4b98-b9ca-dbf395693a0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:30.238713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:30.239845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:30.240850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 535/1085] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:30.245889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f59bd8-f9f3-4b98-b9ca-dbf395693a0d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.271226 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1f0f1-f5d4-458b-93a3-28b7fb3feae0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.311275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd9f92-db77-4633-a553-4a3fc0c61ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.311884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9f92-db77-4633-a553-4a3fc0c61ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.312782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9f92-db77-4633-a553-4a3fc0c61ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.313221 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9f92-db77-4633-a553-4a3fc0c61ff7 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.314002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd9f92-db77-4633-a553-4a3fc0c61ff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:30.314307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd9f92-db77-4633-a553-4a3fc0c61ff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.316186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd9f92-db77-4633-a553-4a3fc0c61ff7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.332234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 551/1086] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:30.337740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd9f92-db77-4633-a553-4a3fc0c61ff7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.366362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.367480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f59bd8-f9f3-4b98-b9ca-dbf395693a0d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.402978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d48c9e-a75e-4e50-ab9d-0de2f8cb9427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.403579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d48c9e-a75e-4e50-ab9d-0de2f8cb9427 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.403855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d48c9e-a75e-4e50-ab9d-0de2f8cb9427 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.404121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d48c9e-a75e-4e50-ab9d-0de2f8cb9427 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.404781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d48c9e-a75e-4e50-ab9d-0de2f8cb9427 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:30.405075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d48c9e-a75e-4e50-ab9d-0de2f8cb9427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.407373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d48c9e-a75e-4e50-ab9d-0de2f8cb9427 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.416065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 536/1087] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:30.422644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d48c9e-a75e-4e50-ab9d-0de2f8cb9427 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.439212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd9f92-db77-4633-a553-4a3fc0c61ff7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.446733 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.474009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ec828-75bf-44e9-81ad-c33a0afb8b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.474726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ec828-75bf-44e9-81ad-c33a0afb8b30 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.474997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ec828-75bf-44e9-81ad-c33a0afb8b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.475329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ec828-75bf-44e9-81ad-c33a0afb8b30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.482411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ec828-75bf-44e9-81ad-c33a0afb8b30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.484001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ec828-75bf-44e9-81ad-c33a0afb8b30 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9b5ec828-75bf-44e9-81ad-c33a0afb8b30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:45:30.496703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:30.497841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:30.499153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 552/1088] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:30.503524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ec828-75bf-44e9-81ad-c33a0afb8b30 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.525888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d48c9e-a75e-4e50-ab9d-0de2f8cb9427 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.559808 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13fd9a-4358-4173-b489-1a9b7d4b7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.560427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13fd9a-4358-4173-b489-1a9b7d4b7b37 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.560697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13fd9a-4358-4173-b489-1a9b7d4b7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.560963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13fd9a-4358-4173-b489-1a9b7d4b7b37 None admin] PATH_INFO: `/v3/users/bdc795cddbe74d6481640630582f5427` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.562706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13fd9a-4358-4173-b489-1a9b7d4b7b37 None admin] RBAC: Authorizing `identity:get_user(user_id=bdc795cddbe74d6481640630582f5427)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.564100 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13fd9a-4358-4173-b489-1a9b7d4b7b37 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.565697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 537/1089] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/users/bdc795cddbe74d6481640630582f5427 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:30.571293 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13fd9a-4358-4173-b489-1a9b7d4b7b37 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.592111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.603831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ec828-75bf-44e9-81ad-c33a0afb8b30 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.639499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc04e-7223-4dce-b5e0-34556c4d5bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.640101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc04e-7223-4dce-b5e0-34556c4d5bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.641319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc04e-7223-4dce-b5e0-34556c4d5bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.641749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc04e-7223-4dce-b5e0-34556c4d5bc9 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.642480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc04e-7223-4dce-b5e0-34556c4d5bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:30.642779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc04e-7223-4dce-b5e0-34556c4d5bc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.644205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc04e-7223-4dce-b5e0-34556c4d5bc9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.661806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 553/1090] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:30.666872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.667871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc04e-7223-4dce-b5e0-34556c4d5bc9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.676645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13fd9a-4358-4173-b489-1a9b7d4b7b37 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.711213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ddccd-bd77-4a66-868c-88f439764e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.711829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ddccd-bd77-4a66-868c-88f439764e89 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.712106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ddccd-bd77-4a66-868c-88f439764e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.712370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ddccd-bd77-4a66-868c-88f439764e89 None admin] PATH_INFO: `/v3/projects/a4162287dec44feba447d5b1eea66e69` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.713454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ddccd-bd77-4a66-868c-88f439764e89 None admin] RBAC: Authorizing `identity:get_project(project_id=a4162287dec44feba447d5b1eea66e69)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.714877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ddccd-bd77-4a66-868c-88f439764e89 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.716478 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 538/1091] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/projects/a4162287dec44feba447d5b1eea66e69 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:30.722265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ddccd-bd77-4a66-868c-88f439764e89 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:30.767571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc04e-7223-4dce-b5e0-34556c4d5bc9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.802256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f672bb1-fd2e-4732-9e66-c9c05d79d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.802849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f672bb1-fd2e-4732-9e66-c9c05d79d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.803121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f672bb1-fd2e-4732-9e66-c9c05d79d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.803385 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f672bb1-fd2e-4732-9e66-c9c05d79d8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.818493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:30.819684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ddccd-bd77-4a66-868c-88f439764e89 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:30.853211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd6504-4f43-4051-a6b9-0253d81c056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:30.853892 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd6504-4f43-4051-a6b9-0253d81c056b None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:30.854171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd6504-4f43-4051-a6b9-0253d81c056b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:30.854495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd6504-4f43-4051-a6b9-0253d81c056b None admin] PATH_INFO: `/v3/projects/a4162287dec44feba447d5b1eea66e69/users/bdc795cddbe74d6481640630582f5427/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:30.856394 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd6504-4f43-4051-a6b9-0253d81c056b None admin] RBAC: Authorizing `identity:create_grant(project_id=a4162287dec44feba447d5b1eea66e69, user_id=bdc795cddbe74d6481640630582f5427, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.857961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd6504-4f43-4051-a6b9-0253d81c056b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.868662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f672bb1-fd2e-4732-9e66-c9c05d79d8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:30.870991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f672bb1-fd2e-4732-9e66-c9c05d79d8c8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:30.918304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 539/1092] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:30 2022] PUT /identity/v3/projects/a4162287dec44feba447d5b1eea66e69/users/bdc795cddbe74d6481640630582f5427/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:30.974008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 554/1093] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:45:30.980007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd6504-4f43-4051-a6b9-0253d81c056b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.003950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.086643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd6504-4f43-4051-a6b9-0253d81c056b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.120682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c38e5-0649-4336-b419-4fe01ab88b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.121304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c38e5-0649-4336-b419-4fe01ab88b7f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.121693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c38e5-0649-4336-b419-4fe01ab88b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.121965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c38e5-0649-4336-b419-4fe01ab88b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.131823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c38e5-0649-4336-b419-4fe01ab88b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.133241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c38e5-0649-4336-b419-4fe01ab88b7f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-b61c38e5-0649-4336-b419-4fe01ab88b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:45:31.147664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:31.148732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:45:31.149699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:45:31.149699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:45:31.149699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:31.149699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 540/1094] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:31.154608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f672bb1-fd2e-4732-9e66-c9c05d79d8c8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.200380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.253114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f672bb1-fd2e-4732-9e66-c9c05d79d8c8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.286937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c1abf-8146-4fd2-9991-836aeaab126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.287534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c1abf-8146-4fd2-9991-836aeaab126b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.287807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c1abf-8146-4fd2-9991-836aeaab126b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.288073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c1abf-8146-4fd2-9991-836aeaab126b None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.288700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c1abf-8146-4fd2-9991-836aeaab126b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:31.288996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c1abf-8146-4fd2-9991-836aeaab126b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.290381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c1abf-8146-4fd2-9991-836aeaab126b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.301740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 555/1095] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:31.307379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c38e5-0649-4336-b419-4fe01ab88b7f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.377539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.406906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c38e5-0649-4336-b419-4fe01ab88b7f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.440005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b68be1-0009-470a-888d-fb54db6582a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.440627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b68be1-0009-470a-888d-fb54db6582a8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.440897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b68be1-0009-470a-888d-fb54db6582a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.441162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b68be1-0009-470a-888d-fb54db6582a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.447562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b68be1-0009-470a-888d-fb54db6582a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.448983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b68be1-0009-470a-888d-fb54db6582a8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-10b68be1-0009-470a-888d-fb54db6582a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:45:31.461092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:31.462768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:31.464064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:45:31.464064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:45:31.464064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:45:31.464064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:45:31.464064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:45:31.464064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:45:31.464064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:45:31.464064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:45:31.464064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 541/1096] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:45:31.468090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c1abf-8146-4fd2-9991-836aeaab126b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.569394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c1abf-8146-4fd2-9991-836aeaab126b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.576223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.603590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1eb44-b3b8-4f38-8f14-35ff3cc12cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.604192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1eb44-b3b8-4f38-8f14-35ff3cc12cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.604470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1eb44-b3b8-4f38-8f14-35ff3cc12cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.604742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1eb44-b3b8-4f38-8f14-35ff3cc12cd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.605429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1eb44-b3b8-4f38-8f14-35ff3cc12cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:31.605765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1eb44-b3b8-4f38-8f14-35ff3cc12cd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.607189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1eb44-b3b8-4f38-8f14-35ff3cc12cd3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.618969 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 556/1097] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:31.625245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b68be1-0009-470a-888d-fb54db6582a8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:31.723993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b68be1-0009-470a-888d-fb54db6582a8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:31.754047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:31.758854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827530d9-cf84-48d4-bc82-b351f560367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:31.759460 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827530d9-cf84-48d4-bc82-b351f560367f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:31.759735 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827530d9-cf84-48d4-bc82-b351f560367f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:31.760007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827530d9-cf84-48d4-bc82-b351f560367f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:31.760793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827530d9-cf84-48d4-bc82-b351f560367f None admin] RBAC: Adding query filter params (role.id=77f77a268f804d579d79685e961299d2, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=6ef753445d864a0ab30ec970446b29cd) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:31.761103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827530d9-cf84-48d4-bc82-b351f560367f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:31.762557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827530d9-cf84-48d4-bc82-b351f560367f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:31.768832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 542/1098] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:31 2022] GET /identity/v3/role_assignments?user.id=6ef753445d864a0ab30ec970446b29cd&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=77f77a268f804d579d79685e961299d2 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:32.816541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e9a2d-0ef0-466c-b7d1-810a38351ea5 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.817051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e9a2d-0ef0-466c-b7d1-810a38351ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.817168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e9a2d-0ef0-466c-b7d1-810a38351ea5 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.818455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 557/1099] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:32.823535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df85256-8f31-4274-9bea-8ffdf9dfe307 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:32.823946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df85256-8f31-4274-9bea-8ffdf9dfe307 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:32.824073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df85256-8f31-4274-9bea-8ffdf9dfe307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:32.841797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2df85256-8f31-4274-9bea-8ffdf9dfe307 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:32.842965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2df85256-8f31-4274-9bea-8ffdf9dfe307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:32.908528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 543/1100] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:33.180965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e9a2d-0ef0-466c-b7d1-810a38351ea5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.282259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e9a2d-0ef0-466c-b7d1-810a38351ea5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.315504 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d0b12-4204-4cfa-b1b2-d33f32c016ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.316118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d0b12-4204-4cfa-b1b2-d33f32c016ce None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.316390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d0b12-4204-4cfa-b1b2-d33f32c016ce None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.316656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d0b12-4204-4cfa-b1b2-d33f32c016ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.326633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d0b12-4204-4cfa-b1b2-d33f32c016ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-044d0b12-4204-4cfa-b1b2-d33f32c016ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:33.331907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:33.333019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:33.334112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 558/1101] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:33.338872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df85256-8f31-4274-9bea-8ffdf9dfe307 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.434692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df85256-8f31-4274-9bea-8ffdf9dfe307 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.460000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:33.468270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3260d1-7986-438e-85d5-88b35ddafca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.468865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3260d1-7986-438e-85d5-88b35ddafca4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.469136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3260d1-7986-438e-85d5-88b35ddafca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.470834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3260d1-7986-438e-85d5-88b35ddafca4 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.470834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3260d1-7986-438e-85d5-88b35ddafca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:33.470834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3260d1-7986-438e-85d5-88b35ddafca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:33.471687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3260d1-7986-438e-85d5-88b35ddafca4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:33.479400 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 544/1102] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:33.485159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d0b12-4204-4cfa-b1b2-d33f32c016ce None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.513547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:33.583827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d0b12-4204-4cfa-b1b2-d33f32c016ce None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.615742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e4bb7-7988-4b83-8bce-748ac2d80de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.616347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e4bb7-7988-4b83-8bce-748ac2d80de0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.616619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e4bb7-7988-4b83-8bce-748ac2d80de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.616886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e4bb7-7988-4b83-8bce-748ac2d80de0 None admin] PATH_INFO: `/v3/users/bdc795cddbe74d6481640630582f5427` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.617993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e4bb7-7988-4b83-8bce-748ac2d80de0 None admin] RBAC: Authorizing `identity:get_user(user_id=bdc795cddbe74d6481640630582f5427)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:33.619399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e4bb7-7988-4b83-8bce-748ac2d80de0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:33.620940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 559/1103] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/users/bdc795cddbe74d6481640630582f5427 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:33.627412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3260d1-7986-438e-85d5-88b35ddafca4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:33.728213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3260d1-7986-438e-85d5-88b35ddafca4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:33.761828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc455d-3d34-4dde-b721-09284e1e9d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:33.762420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc455d-3d34-4dde-b721-09284e1e9d28 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:33.762694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc455d-3d34-4dde-b721-09284e1e9d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:33.762959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc455d-3d34-4dde-b721-09284e1e9d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:33.817456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:33.829692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc455d-3d34-4dde-b721-09284e1e9d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:33.831120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc455d-3d34-4dde-b721-09284e1e9d28 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:33.926782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 545/1104] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:33.932643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e4bb7-7988-4b83-8bce-748ac2d80de0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:34.022589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:34.028860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e4bb7-7988-4b83-8bce-748ac2d80de0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:34.063993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f920f87-1980-41cb-93b4-105e0a92ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:34.063993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f920f87-1980-41cb-93b4-105e0a92ea96 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:34.063993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f920f87-1980-41cb-93b4-105e0a92ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:34.063993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f920f87-1980-41cb-93b4-105e0a92ea96 None admin] PATH_INFO: `/v3/projects/a4162287dec44feba447d5b1eea66e69` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:34.064973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f920f87-1980-41cb-93b4-105e0a92ea96 None admin] RBAC: Authorizing `identity:get_project(project_id=a4162287dec44feba447d5b1eea66e69)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:34.066467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f920f87-1980-41cb-93b4-105e0a92ea96 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:34.068168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 560/1105] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:45:33 2022] GET /identity/v3/projects/a4162287dec44feba447d5b1eea66e69 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:34.074290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc455d-3d34-4dde-b721-09284e1e9d28 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:34.158535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:34.170078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc455d-3d34-4dde-b721-09284e1e9d28 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:34.203922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f9f41-01cb-41c1-a37f-8f8f438d6668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:34.204515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f9f41-01cb-41c1-a37f-8f8f438d6668 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:34.204792 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f9f41-01cb-41c1-a37f-8f8f438d6668 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:34.205063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f9f41-01cb-41c1-a37f-8f8f438d6668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:34.205821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f9f41-01cb-41c1-a37f-8f8f438d6668 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=a4162287dec44feba447d5b1eea66e69, user.id=bdc795cddbe74d6481640630582f5427) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:34.206126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f9f41-01cb-41c1-a37f-8f8f438d6668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:34.207537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f9f41-01cb-41c1-a37f-8f8f438d6668 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:34.213165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 546/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:34 2022] GET /identity/v3/role_assignments?user.id=bdc795cddbe74d6481640630582f5427&scope.project.id=a4162287dec44feba447d5b1eea66e69&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:36.106714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a5ec-5d52-481b-9ede-75f8ee4fd201 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.107245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a5ec-5d52-481b-9ede-75f8ee4fd201 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.107245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a5ec-5d52-481b-9ede-75f8ee4fd201 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.108558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 561/1107] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:36.114192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f666fd0-3c61-4929-90b3-c4a774d53c86 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.114622 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f666fd0-3c61-4929-90b3-c4a774d53c86 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.114715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f666fd0-3c61-4929-90b3-c4a774d53c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.132848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7f666fd0-3c61-4929-90b3-c4a774d53c86 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:36.134049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7f666fd0-3c61-4929-90b3-c4a774d53c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:36.198655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 547/1108] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:36.464452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a5ec-5d52-481b-9ede-75f8ee4fd201 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.563564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a5ec-5d52-481b-9ede-75f8ee4fd201 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.596003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff52b5-f325-4128-85dd-9ea8b64eafb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.596609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff52b5-f325-4128-85dd-9ea8b64eafb8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.596882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff52b5-f325-4128-85dd-9ea8b64eafb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.597153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff52b5-f325-4128-85dd-9ea8b64eafb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.598272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff52b5-f325-4128-85dd-9ea8b64eafb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:36.599691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff52b5-f325-4128-85dd-9ea8b64eafb8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:36.601218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 562/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:36.606859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f666fd0-3c61-4929-90b3-c4a774d53c86 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:36.685504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:36.703126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f666fd0-3c61-4929-90b3-c4a774d53c86 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:36.739590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa83ef-d088-43d2-9168-44b39f3fbf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:36.740183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa83ef-d088-43d2-9168-44b39f3fbf5a None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:36.740459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa83ef-d088-43d2-9168-44b39f3fbf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:36.740726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa83ef-d088-43d2-9168-44b39f3fbf5a None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:36.741363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa83ef-d088-43d2-9168-44b39f3fbf5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:36.742815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa83ef-d088-43d2-9168-44b39f3fbf5a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:36.844655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 548/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:45:36 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:38.757819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112fd49-34da-4aa8-980b-86f465d51ef1 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.758316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112fd49-34da-4aa8-980b-86f465d51ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.758316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112fd49-34da-4aa8-980b-86f465d51ef1 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.759581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 563/1111] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:38.764685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122fb7a-a15c-49da-90f3-bf551233ea57 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:38.765169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122fb7a-a15c-49da-90f3-bf551233ea57 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:38.765586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122fb7a-a15c-49da-90f3-bf551233ea57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:38.783907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1122fb7a-a15c-49da-90f3-bf551233ea57 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:38.785069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1122fb7a-a15c-49da-90f3-bf551233ea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:38.848517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 549/1112] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:39.124996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112fd49-34da-4aa8-980b-86f465d51ef1 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.155039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.225183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112fd49-34da-4aa8-980b-86f465d51ef1 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.256918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6313af9-834f-4142-b79b-384967f0eaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.257550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6313af9-834f-4142-b79b-384967f0eaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.257825 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6313af9-834f-4142-b79b-384967f0eaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.258093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6313af9-834f-4142-b79b-384967f0eaa8 None admin] PATH_INFO: `/v3/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.259453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6313af9-834f-4142-b79b-384967f0eaa8 None admin] RBAC: Authorizing `identity:get_role(role_id=6a99e3ee2e8546c8a6cc6f4e33997bfd)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.260794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6313af9-834f-4142-b79b-384967f0eaa8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.262111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 564/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:39.268682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122fb7a-a15c-49da-90f3-bf551233ea57 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.334346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.366282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122fb7a-a15c-49da-90f3-bf551233ea57 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.400543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e5d9a-2308-4a61-9a8f-2e4e0517d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.401125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e5d9a-2308-4a61-9a8f-2e4e0517d020 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.401400 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e5d9a-2308-4a61-9a8f-2e4e0517d020 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.401699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e5d9a-2308-4a61-9a8f-2e4e0517d020 None admin] PATH_INFO: `/v3/users/e833ef05823b43afbd9fc95ecda01b38` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.414829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e5d9a-2308-4a61-9a8f-2e4e0517d020 None admin] RBAC: Authorizing `identity:get_user(user_id=e833ef05823b43afbd9fc95ecda01b38)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.416612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e5d9a-2308-4a61-9a8f-2e4e0517d020 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.418550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 550/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/users/e833ef05823b43afbd9fc95ecda01b38 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:39.424430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6313af9-834f-4142-b79b-384967f0eaa8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.520200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.524065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6313af9-834f-4142-b79b-384967f0eaa8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.558629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b320ec5-693f-4629-9d73-e17f45b70078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.559251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320ec5-693f-4629-9d73-e17f45b70078 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.559530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320ec5-693f-4629-9d73-e17f45b70078 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.559800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320ec5-693f-4629-9d73-e17f45b70078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.625386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b320ec5-693f-4629-9d73-e17f45b70078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.626853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b320ec5-693f-4629-9d73-e17f45b70078 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.719371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.723662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 565/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:39.729644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e5d9a-2308-4a61-9a8f-2e4e0517d020 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.825106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e5d9a-2308-4a61-9a8f-2e4e0517d020 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.850797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.858959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0be4-17d9-4860-a8b3-b059ad7bb5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.862282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0be4-17d9-4860-a8b3-b059ad7bb5bb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.862282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0be4-17d9-4860-a8b3-b059ad7bb5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.862282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0be4-17d9-4860-a8b3-b059ad7bb5bb None admin] PATH_INFO: `/v3/projects/a4162287dec44feba447d5b1eea66e69` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.862282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b0be4-17d9-4860-a8b3-b059ad7bb5bb None admin] RBAC: Authorizing `identity:get_project(project_id=a4162287dec44feba447d5b1eea66e69)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:39.862835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b0be4-17d9-4860-a8b3-b059ad7bb5bb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:39.864439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 551/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/projects/a4162287dec44feba447d5b1eea66e69 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:39.870533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b320ec5-693f-4629-9d73-e17f45b70078 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:39.964710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b320ec5-693f-4629-9d73-e17f45b70078 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:39.996873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0cee-e802-4363-95ff-192ac3335771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:39.997397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0cee-e802-4363-95ff-192ac3335771 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:39.997699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0cee-e802-4363-95ff-192ac3335771 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:39.997964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0cee-e802-4363-95ff-192ac3335771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:39.998701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0cee-e802-4363-95ff-192ac3335771 None admin] RBAC: Adding query filter params (role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=a4162287dec44feba447d5b1eea66e69, user.id=e833ef05823b43afbd9fc95ecda01b38) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:39.998998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0cee-e802-4363-95ff-192ac3335771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:40.000485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc0cee-e802-4363-95ff-192ac3335771 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:40.006465 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 566/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:39 2022] GET /identity/v3/role_assignments?user.id=e833ef05823b43afbd9fc95ecda01b38&scope.project.id=a4162287dec44feba447d5b1eea66e69&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:41.859726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c582d98-7383-4049-8c50-cbdf7d384c59 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.860344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c582d98-7383-4049-8c50-cbdf7d384c59 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.860344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c582d98-7383-4049-8c50-cbdf7d384c59 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.861596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 552/1118] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:41.866643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a6cf6-a0c2-4784-8166-243dfb31fed6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:41.867064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a6cf6-a0c2-4784-8166-243dfb31fed6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:41.867163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a6cf6-a0c2-4784-8166-243dfb31fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:41.884538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-352a6cf6-a0c2-4784-8166-243dfb31fed6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:41.885729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-352a6cf6-a0c2-4784-8166-243dfb31fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:41.940012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:41.949831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 567/1119] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:42.216601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c582d98-7383-4049-8c50-cbdf7d384c59 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.314591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c582d98-7383-4049-8c50-cbdf7d384c59 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.347652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed5ba7-e417-4a12-b8e9-1c287b7d86a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.348261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed5ba7-e417-4a12-b8e9-1c287b7d86a3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.348532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed5ba7-e417-4a12-b8e9-1c287b7d86a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.348799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed5ba7-e417-4a12-b8e9-1c287b7d86a3 None admin] PATH_INFO: `/v3/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.350183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed5ba7-e417-4a12-b8e9-1c287b7d86a3 None admin] RBAC: Authorizing `identity:get_role(role_id=6a99e3ee2e8546c8a6cc6f4e33997bfd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.351520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed5ba7-e417-4a12-b8e9-1c287b7d86a3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.352809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 553/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:42.359207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a6cf6-a0c2-4784-8166-243dfb31fed6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.453884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a6cf6-a0c2-4784-8166-243dfb31fed6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.487767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e9fc-21bb-4802-b336-a42111b224ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.488315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e9fc-21bb-4802-b336-a42111b224ab None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.488586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e9fc-21bb-4802-b336-a42111b224ab None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.488854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e9fc-21bb-4802-b336-a42111b224ab None admin] PATH_INFO: `/v3/users/e833ef05823b43afbd9fc95ecda01b38` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.489971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e9fc-21bb-4802-b336-a42111b224ab None admin] RBAC: Authorizing `identity:get_user(user_id=e833ef05823b43afbd9fc95ecda01b38)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.491385 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e9fc-21bb-4802-b336-a42111b224ab None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.492940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 568/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/users/e833ef05823b43afbd9fc95ecda01b38 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:42.498920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed5ba7-e417-4a12-b8e9-1c287b7d86a3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.558592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:42.595803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed5ba7-e417-4a12-b8e9-1c287b7d86a3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.629768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f7bb1-78de-4d9e-8c4e-386e1b931a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.630381 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f7bb1-78de-4d9e-8c4e-386e1b931a96 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.630657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f7bb1-78de-4d9e-8c4e-386e1b931a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.630925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f7bb1-78de-4d9e-8c4e-386e1b931a96 None admin] PATH_INFO: `/v3/projects/a4162287dec44feba447d5b1eea66e69` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.632027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f7bb1-78de-4d9e-8c4e-386e1b931a96 None admin] RBAC: Authorizing `identity:get_project(project_id=a4162287dec44feba447d5b1eea66e69)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.633434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f7bb1-78de-4d9e-8c4e-386e1b931a96 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.635055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 554/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:45:42 2022] GET /identity/v3/projects/a4162287dec44feba447d5b1eea66e69 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:42.640920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e9fc-21bb-4802-b336-a42111b224ab None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:42.698146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:42.737351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e9fc-21bb-4802-b336-a42111b224ab None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:42.769807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e129415-7c85-457f-8421-9ec09f8e25bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:42.770386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129415-7c85-457f-8421-9ec09f8e25bf None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:42.770683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129415-7c85-457f-8421-9ec09f8e25bf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:42.770951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129415-7c85-457f-8421-9ec09f8e25bf None admin] PATH_INFO: `/v3/projects/a4162287dec44feba447d5b1eea66e69/users/e833ef05823b43afbd9fc95ecda01b38/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:42.773015 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e129415-7c85-457f-8421-9ec09f8e25bf None admin] RBAC: Authorizing `identity:create_grant(project_id=a4162287dec44feba447d5b1eea66e69, user_id=e833ef05823b43afbd9fc95ecda01b38, role_id=6a99e3ee2e8546c8a6cc6f4e33997bfd)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:42.774452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e129415-7c85-457f-8421-9ec09f8e25bf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:42.844094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 569/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:42 2022] PUT /identity/v3/projects/a4162287dec44feba447d5b1eea66e69/users/e833ef05823b43afbd9fc95ecda01b38/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:44.771847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a42ad-bf84-4a7f-83f8-cb97f6fa8303 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.772366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a42ad-bf84-4a7f-83f8-cb97f6fa8303 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.772366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a42ad-bf84-4a7f-83f8-cb97f6fa8303 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.773809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 555/1124] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:44.779030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208edd6-59f2-4dba-9012-42fe75f59d54 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:44.779446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208edd6-59f2-4dba-9012-42fe75f59d54 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:44.779553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208edd6-59f2-4dba-9012-42fe75f59d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:44.798574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b208edd6-59f2-4dba-9012-42fe75f59d54 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:44.799735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b208edd6-59f2-4dba-9012-42fe75f59d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:44.863855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 570/1125] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:45.129866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a42ad-bf84-4a7f-83f8-cb97f6fa8303 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:45.228479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a42ad-bf84-4a7f-83f8-cb97f6fa8303 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:45.259541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:45.265713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205567af-1fa1-4361-bbe5-cc49e6f12a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:45.266333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205567af-1fa1-4361-bbe5-cc49e6f12a9a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:45.266604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205567af-1fa1-4361-bbe5-cc49e6f12a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:45.266870 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205567af-1fa1-4361-bbe5-cc49e6f12a9a None admin] PATH_INFO: `/v3/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:45.268234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205567af-1fa1-4361-bbe5-cc49e6f12a9a None admin] RBAC: Authorizing `identity:get_role(role_id=6a99e3ee2e8546c8a6cc6f4e33997bfd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:45.269610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205567af-1fa1-4361-bbe5-cc49e6f12a9a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:45.270956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 556/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:45 2022] GET /identity/v3/roles/6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:45.276745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208edd6-59f2-4dba-9012-42fe75f59d54 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:45.329035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:45.378258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208edd6-59f2-4dba-9012-42fe75f59d54 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:45.413122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf36b9-38dc-4ef2-86c8-894e01f5e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:45.413693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf36b9-38dc-4ef2-86c8-894e01f5e80f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:45.413968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf36b9-38dc-4ef2-86c8-894e01f5e80f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:45.414233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf36b9-38dc-4ef2-86c8-894e01f5e80f None admin] PATH_INFO: `/v3/users/e833ef05823b43afbd9fc95ecda01b38` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:45.415329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf36b9-38dc-4ef2-86c8-894e01f5e80f None admin] RBAC: Authorizing `identity:get_user(user_id=e833ef05823b43afbd9fc95ecda01b38)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:45.416858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf36b9-38dc-4ef2-86c8-894e01f5e80f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:45.418460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 571/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:45 2022] GET /identity/v3/users/e833ef05823b43afbd9fc95ecda01b38 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:45.424349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205567af-1fa1-4361-bbe5-cc49e6f12a9a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:45.522005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205567af-1fa1-4361-bbe5-cc49e6f12a9a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:45.555161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca9bb-2c8b-4fc5-b7b8-81d491c87202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:45.555751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca9bb-2c8b-4fc5-b7b8-81d491c87202 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:45.556028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca9bb-2c8b-4fc5-b7b8-81d491c87202 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:45.556296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca9bb-2c8b-4fc5-b7b8-81d491c87202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:45.617882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:45.621168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ca9bb-2c8b-4fc5-b7b8-81d491c87202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:45.622626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ca9bb-2c8b-4fc5-b7b8-81d491c87202 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:45.719466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 557/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:45.725304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf36b9-38dc-4ef2-86c8-894e01f5e80f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:45.821154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf36b9-38dc-4ef2-86c8-894e01f5e80f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:45.837511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:45.853179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba17222-8b18-4165-96d6-2b2c65513401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:45.853817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17222-8b18-4165-96d6-2b2c65513401 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:45.854095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17222-8b18-4165-96d6-2b2c65513401 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:45.854362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17222-8b18-4165-96d6-2b2c65513401 None admin] PATH_INFO: `/v3/projects/a4162287dec44feba447d5b1eea66e69` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:45.855453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba17222-8b18-4165-96d6-2b2c65513401 None admin] RBAC: Authorizing `identity:get_project(project_id=a4162287dec44feba447d5b1eea66e69)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:45.856855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba17222-8b18-4165-96d6-2b2c65513401 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:45.859030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 572/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:45:45 2022] GET /identity/v3/projects/a4162287dec44feba447d5b1eea66e69 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:45.865388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca9bb-2c8b-4fc5-b7b8-81d491c87202 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:45.958037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:45.961722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca9bb-2c8b-4fc5-b7b8-81d491c87202 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:45.994779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40379273-da6b-434c-88f9-a4a7198859af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:45.995309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379273-da6b-434c-88f9-a4a7198859af None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:45.995607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379273-da6b-434c-88f9-a4a7198859af None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:45.996080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379273-da6b-434c-88f9-a4a7198859af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:45.997023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40379273-da6b-434c-88f9-a4a7198859af None admin] RBAC: Adding query filter params (role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd, scope.project.id=a4162287dec44feba447d5b1eea66e69, user.id=e833ef05823b43afbd9fc95ecda01b38) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:45.997346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40379273-da6b-434c-88f9-a4a7198859af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:46.000592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40379273-da6b-434c-88f9-a4a7198859af None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:46.006228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 558/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:45 2022] GET /identity/v3/role_assignments?user.id=e833ef05823b43afbd9fc95ecda01b38&scope.project.id=a4162287dec44feba447d5b1eea66e69&role.id=6a99e3ee2e8546c8a6cc6f4e33997bfd => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:47.996148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c434c52-3692-4e32-8208-60dca4af5614 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:47.996692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c434c52-3692-4e32-8208-60dca4af5614 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:47.996692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c434c52-3692-4e32-8208-60dca4af5614 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:47.998046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 573/1131] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:48.003799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b65da9-7f77-4e73-bb76-afd47ed37b9d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.004247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b65da9-7f77-4e73-bb76-afd47ed37b9d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.004354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b65da9-7f77-4e73-bb76-afd47ed37b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.022287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-00b65da9-7f77-4e73-bb76-afd47ed37b9d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:48.023457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-00b65da9-7f77-4e73-bb76-afd47ed37b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:48.089472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 559/1132] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:48.355208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c434c52-3692-4e32-8208-60dca4af5614 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:48.463062 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c434c52-3692-4e32-8208-60dca4af5614 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:48.496596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02ce26-c0b6-440f-8796-9076c3275779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:48.497216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ce26-c0b6-440f-8796-9076c3275779 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.497520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ce26-c0b6-440f-8796-9076c3275779 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.497792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02ce26-c0b6-440f-8796-9076c3275779 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.498924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02ce26-c0b6-440f-8796-9076c3275779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:48.500330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02ce26-c0b6-440f-8796-9076c3275779 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:48.501908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 574/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:48.507783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b65da9-7f77-4e73-bb76-afd47ed37b9d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:48.598214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:48.606335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b65da9-7f77-4e73-bb76-afd47ed37b9d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:48.639293 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da3376-8bd3-44ed-81be-b151b9613336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:48.640367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da3376-8bd3-44ed-81be-b151b9613336 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:48.640683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da3376-8bd3-44ed-81be-b151b9613336 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:48.640991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da3376-8bd3-44ed-81be-b151b9613336 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:48.641696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da3376-8bd3-44ed-81be-b151b9613336 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:48.643140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da3376-8bd3-44ed-81be-b151b9613336 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:48.765436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 560/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:45:48 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:45:50.658003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797a800-be70-48e6-a2f2-01ac7d6a855b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.658773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797a800-be70-48e6-a2f2-01ac7d6a855b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.658773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797a800-be70-48e6-a2f2-01ac7d6a855b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.660040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 575/1135] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:50.665352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec6d4-d24b-4a8e-b0d3-36937545eccf None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:50.665743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec6d4-d24b-4a8e-b0d3-36937545eccf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:50.665999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec6d4-d24b-4a8e-b0d3-36937545eccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:50.684817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-af1ec6d4-d24b-4a8e-b0d3-36937545eccf None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:50.686072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-af1ec6d4-d24b-4a8e-b0d3-36937545eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:50.750739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 561/1136] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:51.016012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797a800-be70-48e6-a2f2-01ac7d6a855b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:51.070856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:51.115758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797a800-be70-48e6-a2f2-01ac7d6a855b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:51.148513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42255db8-9a3b-4680-afb4-ca9e5daf37ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:51.149118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42255db8-9a3b-4680-afb4-ca9e5daf37ff None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:51.149387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42255db8-9a3b-4680-afb4-ca9e5daf37ff None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:51.149678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42255db8-9a3b-4680-afb4-ca9e5daf37ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:51.150757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42255db8-9a3b-4680-afb4-ca9e5daf37ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:51.152158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42255db8-9a3b-4680-afb4-ca9e5daf37ff None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:51.153721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 576/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:51.159742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec6d4-d24b-4a8e-b0d3-36937545eccf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:51.232221 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:51.257252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec6d4-d24b-4a8e-b0d3-36937545eccf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:51.291977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84fef-12ee-409d-bb40-b552edb30814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:51.292529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84fef-12ee-409d-bb40-b552edb30814 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:51.292837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84fef-12ee-409d-bb40-b552edb30814 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:51.293138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84fef-12ee-409d-bb40-b552edb30814 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:51.293839 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84fef-12ee-409d-bb40-b552edb30814 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:51.295283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84fef-12ee-409d-bb40-b552edb30814 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:51.415319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 562/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:45:51 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:45:53.371242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848e0b7-2f3a-4992-b498-ba6744ed78fc None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.371679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848e0b7-2f3a-4992-b498-ba6744ed78fc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.371791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848e0b7-2f3a-4992-b498-ba6744ed78fc None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.373136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 577/1139] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:53.379192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6270e9-abc0-4baa-99b3-32c7657ccc28 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.384011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6270e9-abc0-4baa-99b3-32c7657ccc28 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.384011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6270e9-abc0-4baa-99b3-32c7657ccc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.397444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ef6270e9-abc0-4baa-99b3-32c7657ccc28 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:53.398635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ef6270e9-abc0-4baa-99b3-32c7657ccc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:53.464673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 563/1140] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:53.738634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848e0b7-2f3a-4992-b498-ba6744ed78fc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.835745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848e0b7-2f3a-4992-b498-ba6744ed78fc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:53.857460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:53.869161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dc60d-2756-4b37-8571-7ce9e4c0db78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:53.875763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dc60d-2756-4b37-8571-7ce9e4c0db78 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:53.875763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dc60d-2756-4b37-8571-7ce9e4c0db78 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:53.875763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dc60d-2756-4b37-8571-7ce9e4c0db78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:53.879898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dc60d-2756-4b37-8571-7ce9e4c0db78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d88dc60d-2756-4b37-8571-7ce9e4c0db78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:53.884570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:53.885771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:53.887042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 578/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:53.891677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6270e9-abc0-4baa-99b3-32c7657ccc28 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:53.947776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:53.987427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6270e9-abc0-4baa-99b3-32c7657ccc28 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.019654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f6e73-607d-4b4a-9c73-4f1592a6a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.020170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f6e73-607d-4b4a-9c73-4f1592a6a208 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.020440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f6e73-607d-4b4a-9c73-4f1592a6a208 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.020702 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f6e73-607d-4b4a-9c73-4f1592a6a208 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.021354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f6e73-607d-4b4a-9c73-4f1592a6a208 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:54.021675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f6e73-607d-4b4a-9c73-4f1592a6a208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.023020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f6e73-607d-4b4a-9c73-4f1592a6a208 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.031727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 564/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:54.037803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dc60d-2756-4b37-8571-7ce9e4c0db78 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.135721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dc60d-2756-4b37-8571-7ce9e4c0db78 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.171094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec07a-665e-4484-938b-c1c452a50a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.171704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec07a-665e-4484-938b-c1c452a50a10 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.171980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec07a-665e-4484-938b-c1c452a50a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.172250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec07a-665e-4484-938b-c1c452a50a10 None admin] PATH_INFO: `/v3/users/2d9e0ca5d23342be827e1c0a7f09e2da` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.185096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ec07a-665e-4484-938b-c1c452a50a10 None admin] RBAC: Authorizing `identity:get_user(user_id=2d9e0ca5d23342be827e1c0a7f09e2da)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.186612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ec07a-665e-4484-938b-c1c452a50a10 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.188218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 579/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:54 2022] GET /identity/v3/users/2d9e0ca5d23342be827e1c0a7f09e2da => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:54.194085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f6e73-607d-4b4a-9c73-4f1592a6a208 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.292321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f6e73-607d-4b4a-9c73-4f1592a6a208 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.314074 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:54.325292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4885-6944-4dd2-9b14-a907397a63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.326068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4885-6944-4dd2-9b14-a907397a63d9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.333427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4885-6944-4dd2-9b14-a907397a63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.333427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4885-6944-4dd2-9b14-a907397a63d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.393626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4885-6944-4dd2-9b14-a907397a63d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.395067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4885-6944-4dd2-9b14-a907397a63d9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.491150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 565/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:45:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:54.497206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec07a-665e-4484-938b-c1c452a50a10 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.537899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:54.593275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec07a-665e-4484-938b-c1c452a50a10 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.625682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6b5da-b768-47a0-a672-55010017601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.626290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6b5da-b768-47a0-a672-55010017601c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.626563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6b5da-b768-47a0-a672-55010017601c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.626829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6b5da-b768-47a0-a672-55010017601c None admin] PATH_INFO: `/v3/projects/9399c38cce5142e8a02094e2a2a3e7f1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.627908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6b5da-b768-47a0-a672-55010017601c None admin] RBAC: Authorizing `identity:get_project(project_id=9399c38cce5142e8a02094e2a2a3e7f1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.629318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6b5da-b768-47a0-a672-55010017601c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.630953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 580/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:45:54 2022] GET /identity/v3/projects/9399c38cce5142e8a02094e2a2a3e7f1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:54.637062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4885-6944-4dd2-9b14-a907397a63d9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:54.660917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:54.733560 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4885-6944-4dd2-9b14-a907397a63d9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:54.765863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafc5f0-96d1-4099-96a3-dbde5d6be9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:54.766453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafc5f0-96d1-4099-96a3-dbde5d6be9ef None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:54.766728 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafc5f0-96d1-4099-96a3-dbde5d6be9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:54.766993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafc5f0-96d1-4099-96a3-dbde5d6be9ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:54.767708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafc5f0-96d1-4099-96a3-dbde5d6be9ef None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=9399c38cce5142e8a02094e2a2a3e7f1, user.id=2d9e0ca5d23342be827e1c0a7f09e2da) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:54.768007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafc5f0-96d1-4099-96a3-dbde5d6be9ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:54.769399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafc5f0-96d1-4099-96a3-dbde5d6be9ef None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:54.774543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 566/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:45:54 2022] GET /identity/v3/role_assignments?user.id=2d9e0ca5d23342be827e1c0a7f09e2da&scope.project.id=9399c38cce5142e8a02094e2a2a3e7f1&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:56.633313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1f49-46bd-4833-bba5-eb1be623800c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.633850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1f49-46bd-4833-bba5-eb1be623800c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.633850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1f49-46bd-4833-bba5-eb1be623800c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.635130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 581/1147] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:56.641081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b9b9-2313-4718-be6c-835e55bea704 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:56.641534 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b9b9-2313-4718-be6c-835e55bea704 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:56.641654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125b9b9-2313-4718-be6c-835e55bea704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:56.659793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b125b9b9-2313-4718-be6c-835e55bea704 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:56.660962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b125b9b9-2313-4718-be6c-835e55bea704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:56.726621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 567/1148] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:56.993041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b1f49-46bd-4833-bba5-eb1be623800c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.092222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b1f49-46bd-4833-bba5-eb1be623800c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.101163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.125645 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dcbb5-bef3-41e9-8d18-10b92159a8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.126251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dcbb5-bef3-41e9-8d18-10b92159a8de None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.126531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dcbb5-bef3-41e9-8d18-10b92159a8de None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.126800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dcbb5-bef3-41e9-8d18-10b92159a8de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.136371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355dcbb5-bef3-41e9-8d18-10b92159a8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-355dcbb5-bef3-41e9-8d18-10b92159a8de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:45:57.141056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:45:57.142197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:45:57.143071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 582/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:45:57.148091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125b9b9-2313-4718-be6c-835e55bea704 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.165153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.243759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125b9b9-2313-4718-be6c-835e55bea704 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.278662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813fae-7fb6-41f4-b7bf-f746f841ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.279257 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813fae-7fb6-41f4-b7bf-f746f841ce07 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.279532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813fae-7fb6-41f4-b7bf-f746f841ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.279907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813fae-7fb6-41f4-b7bf-f746f841ce07 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.280851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d813fae-7fb6-41f4-b7bf-f746f841ce07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:45:57.281153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d813fae-7fb6-41f4-b7bf-f746f841ce07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.282545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d813fae-7fb6-41f4-b7bf-f746f841ce07 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.290591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 568/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:45:57.296949 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dcbb5-bef3-41e9-8d18-10b92159a8de None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.410175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dcbb5-bef3-41e9-8d18-10b92159a8de None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.443463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df992ca-e532-4fe3-af56-42887f7575e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.444856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df992ca-e532-4fe3-af56-42887f7575e4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.444856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df992ca-e532-4fe3-af56-42887f7575e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.444856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df992ca-e532-4fe3-af56-42887f7575e4 None admin] PATH_INFO: `/v3/users/2d9e0ca5d23342be827e1c0a7f09e2da` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.445828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df992ca-e532-4fe3-af56-42887f7575e4 None admin] RBAC: Authorizing `identity:get_user(user_id=2d9e0ca5d23342be827e1c0a7f09e2da)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.447366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df992ca-e532-4fe3-af56-42887f7575e4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.449002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 583/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/users/2d9e0ca5d23342be827e1c0a7f09e2da => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:57.454897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813fae-7fb6-41f4-b7bf-f746f841ce07 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.531092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.551959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813fae-7fb6-41f4-b7bf-f746f841ce07 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.583794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3a6d8-8e49-40c4-bf81-74c99de69d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.584408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3a6d8-8e49-40c4-bf81-74c99de69d22 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.584680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3a6d8-8e49-40c4-bf81-74c99de69d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.584944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3a6d8-8e49-40c4-bf81-74c99de69d22 None admin] PATH_INFO: `/v3/projects/9399c38cce5142e8a02094e2a2a3e7f1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.586051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3a6d8-8e49-40c4-bf81-74c99de69d22 None admin] RBAC: Authorizing `identity:get_project(project_id=9399c38cce5142e8a02094e2a2a3e7f1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.587457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3a6d8-8e49-40c4-bf81-74c99de69d22 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.589040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 569/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:45:57 2022] GET /identity/v3/projects/9399c38cce5142e8a02094e2a2a3e7f1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:45:57.595569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df992ca-e532-4fe3-af56-42887f7575e4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:45:57.629667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:57.693562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df992ca-e532-4fe3-af56-42887f7575e4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:45:57.728645 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2aa029-1c6a-4279-8b8b-0f98693dec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:45:57.729292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa029-1c6a-4279-8b8b-0f98693dec73 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:57.729601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa029-1c6a-4279-8b8b-0f98693dec73 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:57.729873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2aa029-1c6a-4279-8b8b-0f98693dec73 None admin] PATH_INFO: `/v3/projects/9399c38cce5142e8a02094e2a2a3e7f1/users/2d9e0ca5d23342be827e1c0a7f09e2da/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:57.731761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2aa029-1c6a-4279-8b8b-0f98693dec73 None admin] RBAC: Authorizing `identity:create_grant(project_id=9399c38cce5142e8a02094e2a2a3e7f1, user_id=2d9e0ca5d23342be827e1c0a7f09e2da, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:45:57.733201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2aa029-1c6a-4279-8b8b-0f98693dec73 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:45:57.791861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 584/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:45:57 2022] PUT /identity/v3/projects/9399c38cce5142e8a02094e2a2a3e7f1/users/2d9e0ca5d23342be827e1c0a7f09e2da/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:45:59.662131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff954cb-313f-46e9-859b-6ac7585e321d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:59.662628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff954cb-313f-46e9-859b-6ac7585e321d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:59.662628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff954cb-313f-46e9-859b-6ac7585e321d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:59.663931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 570/1154] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:45:59.669086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187386dc-cb42-405d-9c82-0ce07c61f6c2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:45:59.669454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187386dc-cb42-405d-9c82-0ce07c61f6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:45:59.669562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187386dc-cb42-405d-9c82-0ce07c61f6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:45:59.687682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-187386dc-cb42-405d-9c82-0ce07c61f6c2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:45:59.688840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-187386dc-cb42-405d-9c82-0ce07c61f6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:45:59.754002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 585/1155] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:45:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:00.020870 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff954cb-313f-46e9-859b-6ac7585e321d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.122335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff954cb-313f-46e9-859b-6ac7585e321d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:00.155801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3b0a2-e329-45a5-b569-bb4beb6e2ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:00.156442 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3b0a2-e329-45a5-b569-bb4beb6e2ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.156717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3b0a2-e329-45a5-b569-bb4beb6e2ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.156989 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3b0a2-e329-45a5-b569-bb4beb6e2ef5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.167457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3b0a2-e329-45a5-b569-bb4beb6e2ef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d8b3b0a2-e329-45a5-b569-bb4beb6e2ef5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:00.172558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:00.173715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:46:00.175012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 571/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:00.179587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187386dc-cb42-405d-9c82-0ce07c61f6c2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.205772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:00.276077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187386dc-cb42-405d-9c82-0ce07c61f6c2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:00.308709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e561183-565d-43e0-8bb2-f5f3dd4abac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:00.309297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561183-565d-43e0-8bb2-f5f3dd4abac6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.309596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561183-565d-43e0-8bb2-f5f3dd4abac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.309868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561183-565d-43e0-8bb2-f5f3dd4abac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.310517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e561183-565d-43e0-8bb2-f5f3dd4abac6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:00.311336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e561183-565d-43e0-8bb2-f5f3dd4abac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:00.312794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e561183-565d-43e0-8bb2-f5f3dd4abac6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:00.320723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 586/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:00.326566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3b0a2-e329-45a5-b569-bb4beb6e2ef5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.336112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:00.425896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3b0a2-e329-45a5-b569-bb4beb6e2ef5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:00.458864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ce7d1-f248-4589-b1dd-ab6f3be4f9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:00.459477 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ce7d1-f248-4589-b1dd-ab6f3be4f9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.459757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ce7d1-f248-4589-b1dd-ab6f3be4f9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.460031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ce7d1-f248-4589-b1dd-ab6f3be4f9e6 None admin] PATH_INFO: `/v3/users/2d9e0ca5d23342be827e1c0a7f09e2da` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.461132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ce7d1-f248-4589-b1dd-ab6f3be4f9e6 None admin] RBAC: Authorizing `identity:get_user(user_id=2d9e0ca5d23342be827e1c0a7f09e2da)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:00.462581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ce7d1-f248-4589-b1dd-ab6f3be4f9e6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:00.464143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 572/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/users/2d9e0ca5d23342be827e1c0a7f09e2da => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:00.471373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e561183-565d-43e0-8bb2-f5f3dd4abac6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.556495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:00.568831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e561183-565d-43e0-8bb2-f5f3dd4abac6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:00.601873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6602f-9b17-40c6-9d4b-4501f97836fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:00.602465 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6602f-9b17-40c6-9d4b-4501f97836fc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.602741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6602f-9b17-40c6-9d4b-4501f97836fc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.603008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6602f-9b17-40c6-9d4b-4501f97836fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.667173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6602f-9b17-40c6-9d4b-4501f97836fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:00.668610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6602f-9b17-40c6-9d4b-4501f97836fc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:00.758449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:00.770734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 587/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:00.776635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ce7d1-f248-4589-b1dd-ab6f3be4f9e6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:00.851105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:00.875634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ce7d1-f248-4589-b1dd-ab6f3be4f9e6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:00.908500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc700fc-1cd7-48a8-bae2-fc62c560e7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:00.909117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc700fc-1cd7-48a8-bae2-fc62c560e7de None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:00.909395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc700fc-1cd7-48a8-bae2-fc62c560e7de None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:00.909704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc700fc-1cd7-48a8-bae2-fc62c560e7de None admin] PATH_INFO: `/v3/projects/9399c38cce5142e8a02094e2a2a3e7f1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:00.910807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc700fc-1cd7-48a8-bae2-fc62c560e7de None admin] RBAC: Authorizing `identity:get_project(project_id=9399c38cce5142e8a02094e2a2a3e7f1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:00.912228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc700fc-1cd7-48a8-bae2-fc62c560e7de None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:00.913880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 573/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/projects/9399c38cce5142e8a02094e2a2a3e7f1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:00.920043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6602f-9b17-40c6-9d4b-4501f97836fc None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:01.019249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6602f-9b17-40c6-9d4b-4501f97836fc None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:01.052486 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc79d5-c294-490d-acd7-a0395640b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:01.053073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc79d5-c294-490d-acd7-a0395640b407 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:01.053345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc79d5-c294-490d-acd7-a0395640b407 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:01.053643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc79d5-c294-490d-acd7-a0395640b407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:01.054362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc79d5-c294-490d-acd7-a0395640b407 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=9399c38cce5142e8a02094e2a2a3e7f1, user.id=2d9e0ca5d23342be827e1c0a7f09e2da) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:01.054665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc79d5-c294-490d-acd7-a0395640b407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:01.056083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc79d5-c294-490d-acd7-a0395640b407 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:01.062390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 588/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:00 2022] GET /identity/v3/role_assignments?user.id=2d9e0ca5d23342be827e1c0a7f09e2da&scope.project.id=9399c38cce5142e8a02094e2a2a3e7f1&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:02.984537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cec19-448d-44e6-9508-b36ecb8a2bbd None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:02.985094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cec19-448d-44e6-9508-b36ecb8a2bbd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:02.985094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cec19-448d-44e6-9508-b36ecb8a2bbd None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:02.986428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 574/1162] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:02.991662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b0ae-3d28-4377-b426-299d6d4f9451 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:02.992041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b0ae-3d28-4377-b426-299d6d4f9451 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:02.992216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3b0ae-3d28-4377-b426-299d6d4f9451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.010577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a8c3b0ae-3d28-4377-b426-299d6d4f9451 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:03.011748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a8c3b0ae-3d28-4377-b426-299d6d4f9451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:03.057301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:03.076256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 589/1163] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:03.346458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cec19-448d-44e6-9508-b36ecb8a2bbd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:03.445809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cec19-448d-44e6-9508-b36ecb8a2bbd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:03.477824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa92f38-1655-458f-b86a-aa2db7f6d23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:03.478407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa92f38-1655-458f-b86a-aa2db7f6d23d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.478679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa92f38-1655-458f-b86a-aa2db7f6d23d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.478946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa92f38-1655-458f-b86a-aa2db7f6d23d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.490733 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:03.544742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa92f38-1655-458f-b86a-aa2db7f6d23d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:03.546852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa92f38-1655-458f-b86a-aa2db7f6d23d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:03.640619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 575/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:03.646466 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3b0ae-3d28-4377-b426-299d6d4f9451 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:03.745891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3b0ae-3d28-4377-b426-299d6d4f9451 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:03.778538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f580816-0978-41e6-b98f-d8c6d22147ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:03.779153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580816-0978-41e6-b98f-d8c6d22147ab None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.779428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580816-0978-41e6-b98f-d8c6d22147ab None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.779695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580816-0978-41e6-b98f-d8c6d22147ab None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.786480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f580816-0978-41e6-b98f-d8c6d22147ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:03.787908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f580816-0978-41e6-b98f-d8c6d22147ab None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-3f580816-0978-41e6-b98f-d8c6d22147ab None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:03.799435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:03.800681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 07:46:03.801893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:46:03.805424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 590/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:46:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:03.806536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa92f38-1655-458f-b86a-aa2db7f6d23d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:03.848415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:03.902158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa92f38-1655-458f-b86a-aa2db7f6d23d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:03.935214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfd77b-2d89-427f-8333-16220c3e1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:03.935842 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfd77b-2d89-427f-8333-16220c3e1890 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:03.936118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfd77b-2d89-427f-8333-16220c3e1890 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:03.936388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfd77b-2d89-427f-8333-16220c3e1890 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:03.937646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfd77b-2d89-427f-8333-16220c3e1890 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:03.937948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfd77b-2d89-427f-8333-16220c3e1890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:03.939286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfd77b-2d89-427f-8333-16220c3e1890 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:03.946186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 576/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 07:46:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:05.833836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d959-0fe2-4893-80e4-b7b136566ee1 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:05.834349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d959-0fe2-4893-80e4-b7b136566ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:05.834349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d959-0fe2-4893-80e4-b7b136566ee1 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:05.835704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 591/1167] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:05.840968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa1a9-c6ca-4311-89d8-66669cfd3b30 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:05.841393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa1a9-c6ca-4311-89d8-66669cfd3b30 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:05.841556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfa1a9-c6ca-4311-89d8-66669cfd3b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:05.859287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b9dfa1a9-c6ca-4311-89d8-66669cfd3b30 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:05.860445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b9dfa1a9-c6ca-4311-89d8-66669cfd3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:05.925049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 577/1168] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:06.200373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373d959-0fe2-4893-80e4-b7b136566ee1 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:06.243074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:06.301588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373d959-0fe2-4893-80e4-b7b136566ee1 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:06.337579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30564b-d938-4f80-aa0a-08d3056eace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:06.338186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30564b-d938-4f80-aa0a-08d3056eace0 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:06.338458 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30564b-d938-4f80-aa0a-08d3056eace0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:06.338723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30564b-d938-4f80-aa0a-08d3056eace0 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:06.339369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30564b-d938-4f80-aa0a-08d3056eace0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:06.340726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30564b-d938-4f80-aa0a-08d3056eace0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:06.496771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 592/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Wed Aug 24 07:46:06 2022] POST /identity/v3/domains => generated 267 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:08.409551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a392f-aaf6-4d4e-a0b4-046430c9b707 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.410022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a392f-aaf6-4d4e-a0b4-046430c9b707 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.410116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a392f-aaf6-4d4e-a0b4-046430c9b707 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:08.411428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 578/1170] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:08.416575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10744f-47c7-49ff-9011-127b647d12ae None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.416988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10744f-47c7-49ff-9011-127b647d12ae None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.417122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10744f-47c7-49ff-9011-127b647d12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:08.435027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9a10744f-47c7-49ff-9011-127b647d12ae None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:08.436205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9a10744f-47c7-49ff-9011-127b647d12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:08.501557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 593/1171] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:08.774512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a392f-aaf6-4d4e-a0b4-046430c9b707 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:08.809407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:08.872934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a392f-aaf6-4d4e-a0b4-046430c9b707 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:08.907174 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4bdd7-f73d-4df2-bcb0-a6c2f8f7ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:08.908040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4bdd7-f73d-4df2-bcb0-a6c2f8f7ae12 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:08.908314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4bdd7-f73d-4df2-bcb0-a6c2f8f7ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:08.908583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4bdd7-f73d-4df2-bcb0-a6c2f8f7ae12 None admin] PATH_INFO: `/v3/domains/befa413336d448b98b3ebda27fb5f4d5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:08.918576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4bdd7-f73d-4df2-bcb0-a6c2f8f7ae12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=befa413336d448b98b3ebda27fb5f4d5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:08.919997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4bdd7-f73d-4df2-bcb0-a6c2f8f7ae12 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:08.922561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 579/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Wed Aug 24 07:46:08 2022] GET /identity/v3/domains/befa413336d448b98b3ebda27fb5f4d5 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:08.928667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10744f-47c7-49ff-9011-127b647d12ae None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:08.958602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:09.023425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10744f-47c7-49ff-9011-127b647d12ae None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:09.056233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d18c5-52ed-4a74-9fbb-da1d8bccc186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:09.056829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d18c5-52ed-4a74-9fbb-da1d8bccc186 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:09.057101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d18c5-52ed-4a74-9fbb-da1d8bccc186 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:09.057364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d18c5-52ed-4a74-9fbb-da1d8bccc186 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:09.058016 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d18c5-52ed-4a74-9fbb-da1d8bccc186 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:09.059420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d18c5-52ed-4a74-9fbb-da1d8bccc186 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:09.140959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 594/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:46:08 2022] POST /identity/v3/projects => generated 361 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:11.072321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a336cf-9290-4393-8ce8-9b20fec92a05 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:11.072852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a336cf-9290-4393-8ce8-9b20fec92a05 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:11.072852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a336cf-9290-4393-8ce8-9b20fec92a05 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:11.074244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 580/1174] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:11.079643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c8b5-12dc-401d-a4c3-d5498396da66 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:11.080062 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c8b5-12dc-401d-a4c3-d5498396da66 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:11.080185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742c8b5-12dc-401d-a4c3-d5498396da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:11.098711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8742c8b5-12dc-401d-a4c3-d5498396da66 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:11.099894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8742c8b5-12dc-401d-a4c3-d5498396da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:11.164499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 595/1175] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:11.433538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a336cf-9290-4393-8ce8-9b20fec92a05 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:11.526153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:11.533515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a336cf-9290-4393-8ce8-9b20fec92a05 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:11.566516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6066-2ebb-42f5-b28b-bfd916cb5100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:11.567131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6066-2ebb-42f5-b28b-bfd916cb5100 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:11.567408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6066-2ebb-42f5-b28b-bfd916cb5100 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:11.567679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6066-2ebb-42f5-b28b-bfd916cb5100 None admin] PATH_INFO: `/v3/domains/befa413336d448b98b3ebda27fb5f4d5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:11.568786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa6066-2ebb-42f5-b28b-bfd916cb5100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=befa413336d448b98b3ebda27fb5f4d5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:11.570232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa6066-2ebb-42f5-b28b-bfd916cb5100 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:11.571782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 581/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Wed Aug 24 07:46:11 2022] GET /identity/v3/domains/befa413336d448b98b3ebda27fb5f4d5 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:11.577397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c8b5-12dc-401d-a4c3-d5498396da66 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:11.592553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:11.676003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742c8b5-12dc-401d-a4c3-d5498396da66 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:11.709768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee593b-6450-42db-926f-6518aa3a5e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:11.710390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee593b-6450-42db-926f-6518aa3a5e87 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:11.710670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee593b-6450-42db-926f-6518aa3a5e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:11.710942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee593b-6450-42db-926f-6518aa3a5e87 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:11.711616 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee593b-6450-42db-926f-6518aa3a5e87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:11.713040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee593b-6450-42db-926f-6518aa3a5e87 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:11.808304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 596/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:46:11 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:46:13.768322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194dcfe-488c-4d86-8227-595322bf4145 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:13.768885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194dcfe-488c-4d86-8227-595322bf4145 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:13.768885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194dcfe-488c-4d86-8227-595322bf4145 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:13.770140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 582/1178] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:13.775266 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdc2e1-6e9e-457f-abe7-0b5af26b5144 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:13.775650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdc2e1-6e9e-457f-abe7-0b5af26b5144 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:13.775806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdc2e1-6e9e-457f-abe7-0b5af26b5144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:13.794534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-92cdc2e1-6e9e-457f-abe7-0b5af26b5144 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:13.795732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-92cdc2e1-6e9e-457f-abe7-0b5af26b5144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:13.856601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:13.861313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 597/1179] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:14.132324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194dcfe-488c-4d86-8227-595322bf4145 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.230978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194dcfe-488c-4d86-8227-595322bf4145 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.264818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e5a50-b834-43bd-ab91-672c8dd185a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.265594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5a50-b834-43bd-ab91-672c8dd185a8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.265874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5a50-b834-43bd-ab91-672c8dd185a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.266147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5a50-b834-43bd-ab91-672c8dd185a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.275818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e5a50-b834-43bd-ab91-672c8dd185a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-583e5a50-b834-43bd-ab91-672c8dd185a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:14.280932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:14.282206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:46:14.283688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 583/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:14.288304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdc2e1-6e9e-457f-abe7-0b5af26b5144 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.390175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdc2e1-6e9e-457f-abe7-0b5af26b5144 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.484308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466a45-5f90-4af1-984d-0eb889003599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.484903 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466a45-5f90-4af1-984d-0eb889003599 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.485178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466a45-5f90-4af1-984d-0eb889003599 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.485445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e466a45-5f90-4af1-984d-0eb889003599 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.486131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e466a45-5f90-4af1-984d-0eb889003599 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:14.486426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e466a45-5f90-4af1-984d-0eb889003599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:14.487786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e466a45-5f90-4af1-984d-0eb889003599 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:14.495497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 598/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:14.501998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e5a50-b834-43bd-ab91-672c8dd185a8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.526519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:14.599697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e5a50-b834-43bd-ab91-672c8dd185a8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.632006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cc537-126f-49b5-9848-b4c148d87f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.632615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cc537-126f-49b5-9848-b4c148d87f2b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.632885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cc537-126f-49b5-9848-b4c148d87f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.633149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cc537-126f-49b5-9848-b4c148d87f2b None admin] PATH_INFO: `/v3/users/3ce07c492c3340f6b248bfd91fc4c251` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.645636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cc537-126f-49b5-9848-b4c148d87f2b None admin] RBAC: Authorizing `identity:get_user(user_id=3ce07c492c3340f6b248bfd91fc4c251)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:14.646991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cc537-126f-49b5-9848-b4c148d87f2b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:14.648533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 584/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/users/3ce07c492c3340f6b248bfd91fc4c251 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:14.654409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466a45-5f90-4af1-984d-0eb889003599 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:14.715336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:14.753791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e466a45-5f90-4af1-984d-0eb889003599 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:14.787538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee8a30-884d-456d-beca-b798a5d51bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:14.788137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee8a30-884d-456d-beca-b798a5d51bae None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:14.788394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee8a30-884d-456d-beca-b798a5d51bae None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:14.788662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee8a30-884d-456d-beca-b798a5d51bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:14.852668 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee8a30-884d-456d-beca-b798a5d51bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:14.854123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee8a30-884d-456d-beca-b798a5d51bae None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:14.911255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:14.948507 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 599/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:14.955017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cc537-126f-49b5-9848-b4c148d87f2b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:15.035896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:15.052936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cc537-126f-49b5-9848-b4c148d87f2b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:15.085336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8079e0b-1283-4a39-9088-19333494050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:15.085971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8079e0b-1283-4a39-9088-19333494050f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:15.086244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8079e0b-1283-4a39-9088-19333494050f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:15.086509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8079e0b-1283-4a39-9088-19333494050f None admin] PATH_INFO: `/v3/projects/3b6275a157f04f24948c1906f3e7124e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:15.087590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8079e0b-1283-4a39-9088-19333494050f None admin] RBAC: Authorizing `identity:get_project(project_id=3b6275a157f04f24948c1906f3e7124e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:15.088993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8079e0b-1283-4a39-9088-19333494050f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:15.090645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 585/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:14 2022] GET /identity/v3/projects/3b6275a157f04f24948c1906f3e7124e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:15.097334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee8a30-884d-456d-beca-b798a5d51bae None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:15.192503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee8a30-884d-456d-beca-b798a5d51bae None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:15.226440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af3c7e-364b-41bf-8883-c3b7c3accf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:15.227033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af3c7e-364b-41bf-8883-c3b7c3accf86 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:15.227305 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af3c7e-364b-41bf-8883-c3b7c3accf86 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:15.227573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af3c7e-364b-41bf-8883-c3b7c3accf86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:15.228287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af3c7e-364b-41bf-8883-c3b7c3accf86 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=3b6275a157f04f24948c1906f3e7124e, user.id=3ce07c492c3340f6b248bfd91fc4c251) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:15.228585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af3c7e-364b-41bf-8883-c3b7c3accf86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:15.230033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af3c7e-364b-41bf-8883-c3b7c3accf86 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:15.235375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 600/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:15 2022] GET /identity/v3/role_assignments?user.id=3ce07c492c3340f6b248bfd91fc4c251&scope.project.id=3b6275a157f04f24948c1906f3e7124e&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:17.127687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64834758-5b3f-434d-9062-aaf438fee8cc None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.128232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64834758-5b3f-434d-9062-aaf438fee8cc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.128232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64834758-5b3f-434d-9062-aaf438fee8cc None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.129580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 586/1186] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:17.134807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd3424-8c0e-4be9-a72c-6e8b3974ee63 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.135220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd3424-8c0e-4be9-a72c-6e8b3974ee63 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.135347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd3424-8c0e-4be9-a72c-6e8b3974ee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.153483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d7fd3424-8c0e-4be9-a72c-6e8b3974ee63 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:17.154664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d7fd3424-8c0e-4be9-a72c-6e8b3974ee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:17.174979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:17.218705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 601/1187] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:46:17.484905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64834758-5b3f-434d-9062-aaf438fee8cc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:17.584353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64834758-5b3f-434d-9062-aaf438fee8cc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:17.618162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597de9e-3c77-4978-a91e-adcdb740b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:17.618772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597de9e-3c77-4978-a91e-adcdb740b581 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.619042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597de9e-3c77-4978-a91e-adcdb740b581 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.619305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597de9e-3c77-4978-a91e-adcdb740b581 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.628924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597de9e-3c77-4978-a91e-adcdb740b581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-9597de9e-3c77-4978-a91e-adcdb740b581 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:17.633554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:17.634683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:46:17.635558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 587/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:46:17.640857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd3424-8c0e-4be9-a72c-6e8b3974ee63 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:17.738926 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd3424-8c0e-4be9-a72c-6e8b3974ee63 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:17.771609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35e59c-5d84-4de1-af9f-722222affdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:17.772203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35e59c-5d84-4de1-af9f-722222affdfb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.772479 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35e59c-5d84-4de1-af9f-722222affdfb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.772746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35e59c-5d84-4de1-af9f-722222affdfb None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.773402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35e59c-5d84-4de1-af9f-722222affdfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:17.773728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35e59c-5d84-4de1-af9f-722222affdfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:17.775079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35e59c-5d84-4de1-af9f-722222affdfb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:17.783912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 602/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:17.789864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597de9e-3c77-4978-a91e-adcdb740b581 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:17.802869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:17.887163 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597de9e-3c77-4978-a91e-adcdb740b581 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:17.920629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6895c-1aca-4145-a893-cc2db5f56ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:17.921243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6895c-1aca-4145-a893-cc2db5f56ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:17.921545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6895c-1aca-4145-a893-cc2db5f56ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:17.921897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6895c-1aca-4145-a893-cc2db5f56ba1 None admin] PATH_INFO: `/v3/users/3ce07c492c3340f6b248bfd91fc4c251` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:17.923011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6895c-1aca-4145-a893-cc2db5f56ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=3ce07c492c3340f6b248bfd91fc4c251)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:17.924427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6895c-1aca-4145-a893-cc2db5f56ba1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:17.926022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 588/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:17 2022] GET /identity/v3/users/3ce07c492c3340f6b248bfd91fc4c251 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:17.931794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35e59c-5d84-4de1-af9f-722222affdfb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:17.951084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.030019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35e59c-5d84-4de1-af9f-722222affdfb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.063333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc37b0a-32bc-4330-ba5b-17bef4f3d927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.063942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37b0a-32bc-4330-ba5b-17bef4f3d927 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.064213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37b0a-32bc-4330-ba5b-17bef4f3d927 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.064478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37b0a-32bc-4330-ba5b-17bef4f3d927 None admin] PATH_INFO: `/v3/projects/3b6275a157f04f24948c1906f3e7124e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.065606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc37b0a-32bc-4330-ba5b-17bef4f3d927 None admin] RBAC: Authorizing `identity:get_project(project_id=3b6275a157f04f24948c1906f3e7124e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.067028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc37b0a-32bc-4330-ba5b-17bef4f3d927 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.068622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 603/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:17 2022] GET /identity/v3/projects/3b6275a157f04f24948c1906f3e7124e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:18.074552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6895c-1aca-4145-a893-cc2db5f56ba1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:18.151682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:18.173093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6895c-1aca-4145-a893-cc2db5f56ba1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:18.206690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9bd1f-3ace-4cb1-a4c2-9414a63de87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:18.207330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9bd1f-3ace-4cb1-a4c2-9414a63de87e None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:18.207606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9bd1f-3ace-4cb1-a4c2-9414a63de87e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:18.207875 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9bd1f-3ace-4cb1-a4c2-9414a63de87e None admin] PATH_INFO: `/v3/projects/3b6275a157f04f24948c1906f3e7124e/users/3ce07c492c3340f6b248bfd91fc4c251/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:18.209752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9bd1f-3ace-4cb1-a4c2-9414a63de87e None admin] RBAC: Authorizing `identity:create_grant(project_id=3b6275a157f04f24948c1906f3e7124e, user_id=3ce07c492c3340f6b248bfd91fc4c251, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:18.211157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9bd1f-3ace-4cb1-a4c2-9414a63de87e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:18.271797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 589/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:46:18 2022] PUT /identity/v3/projects/3b6275a157f04f24948c1906f3e7124e/users/3ce07c492c3340f6b248bfd91fc4c251/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:46:20.146016 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aed81-4073-4aed-bb06-70bdd51daff5 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:20.146582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aed81-4073-4aed-bb06-70bdd51daff5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:20.146582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aed81-4073-4aed-bb06-70bdd51daff5 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:20.147894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 604/1193] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:46:20.153163 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19ad10-b798-456d-87e9-4296fc6f286b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:20.153565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19ad10-b798-456d-87e9-4296fc6f286b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:20.153744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19ad10-b798-456d-87e9-4296fc6f286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:20.172653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-be19ad10-b798-456d-87e9-4296fc6f286b None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:46:20.173874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-be19ad10-b798-456d-87e9-4296fc6f286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:46:20.238186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 590/1194] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:46:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:46:20.505919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aed81-4073-4aed-bb06-70bdd51daff5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:20.588591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:20.604038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aed81-4073-4aed-bb06-70bdd51daff5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:20.638003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c0f5f-7e94-4c3a-b94d-625cc17c8c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:20.638617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c0f5f-7e94-4c3a-b94d-625cc17c8c90 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:20.638890 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c0f5f-7e94-4c3a-b94d-625cc17c8c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:20.639190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c0f5f-7e94-4c3a-b94d-625cc17c8c90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:20.649869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c0f5f-7e94-4c3a-b94d-625cc17c8c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ce9c0f5f-7e94-4c3a-b94d-625cc17c8c90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:46:20.654497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:46:20.656422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:46:20.657815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:46:20.661412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 605/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:46:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:46:20.662457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19ad10-b798-456d-87e9-4296fc6f286b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:20.726303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:20.758917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19ad10-b798-456d-87e9-4296fc6f286b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:20.792448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6d2d8-f3f4-4835-bd79-ce5c7f47057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:20.793042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6d2d8-f3f4-4835-bd79-ce5c7f47057d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:20.793314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6d2d8-f3f4-4835-bd79-ce5c7f47057d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:20.793610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6d2d8-f3f4-4835-bd79-ce5c7f47057d None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:20.794266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6d2d8-f3f4-4835-bd79-ce5c7f47057d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:20.794563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6d2d8-f3f4-4835-bd79-ce5c7f47057d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:20.796491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6d2d8-f3f4-4835-bd79-ce5c7f47057d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:20.804328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 591/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:46:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:20.810139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c0f5f-7e94-4c3a-b94d-625cc17c8c90 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:20.908937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c0f5f-7e94-4c3a-b94d-625cc17c8c90 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:20.941418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86aa8c-8740-406e-b2d2-7026745dba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:20.942058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86aa8c-8740-406e-b2d2-7026745dba4f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:20.942336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86aa8c-8740-406e-b2d2-7026745dba4f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:20.942605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86aa8c-8740-406e-b2d2-7026745dba4f None admin] PATH_INFO: `/v3/users/3ce07c492c3340f6b248bfd91fc4c251` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:20.943713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86aa8c-8740-406e-b2d2-7026745dba4f None admin] RBAC: Authorizing `identity:get_user(user_id=3ce07c492c3340f6b248bfd91fc4c251)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:20.945125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86aa8c-8740-406e-b2d2-7026745dba4f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:20.946712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 606/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 07:46:20 2022] GET /identity/v3/users/3ce07c492c3340f6b248bfd91fc4c251 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:20.953073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6d2d8-f3f4-4835-bd79-ce5c7f47057d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:21.049181 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6d2d8-f3f4-4835-bd79-ce5c7f47057d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:21.076023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:21.082084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47970b-d73c-4bf6-9cd2-dcb6922510a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:21.082675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47970b-d73c-4bf6-9cd2-dcb6922510a1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:21.082952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47970b-d73c-4bf6-9cd2-dcb6922510a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:21.083246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47970b-d73c-4bf6-9cd2-dcb6922510a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:21.147832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47970b-d73c-4bf6-9cd2-dcb6922510a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:21.149259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47970b-d73c-4bf6-9cd2-dcb6922510a1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:21.244054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 592/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:46:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:46:21.250638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86aa8c-8740-406e-b2d2-7026745dba4f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:21.266964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:21.349271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86aa8c-8740-406e-b2d2-7026745dba4f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:21.384370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5587c3b-8ff4-4c76-9657-6c185aec055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:21.385000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587c3b-8ff4-4c76-9657-6c185aec055d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:21.385357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587c3b-8ff4-4c76-9657-6c185aec055d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:21.385663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587c3b-8ff4-4c76-9657-6c185aec055d None admin] PATH_INFO: `/v3/projects/3b6275a157f04f24948c1906f3e7124e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:21.386774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5587c3b-8ff4-4c76-9657-6c185aec055d None admin] RBAC: Authorizing `identity:get_project(project_id=3b6275a157f04f24948c1906f3e7124e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:21.388200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5587c3b-8ff4-4c76-9657-6c185aec055d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:21.389919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 607/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 07:46:21 2022] GET /identity/v3/projects/3b6275a157f04f24948c1906f3e7124e => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:21.396057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47970b-d73c-4bf6-9cd2-dcb6922510a1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:46:21.425949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:21.492956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47970b-d73c-4bf6-9cd2-dcb6922510a1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:46:21.524932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49759b-7f4b-4b81-9078-8df51467fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:46:21.525538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49759b-7f4b-4b81-9078-8df51467fc8f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:46:21.525812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49759b-7f4b-4b81-9078-8df51467fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:46:21.526076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49759b-7f4b-4b81-9078-8df51467fc8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:46:21.526785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49759b-7f4b-4b81-9078-8df51467fc8f None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=3b6275a157f04f24948c1906f3e7124e, user.id=3ce07c492c3340f6b248bfd91fc4c251) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:46:21.527083 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49759b-7f4b-4b81-9078-8df51467fc8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:46:21.528474 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49759b-7f4b-4b81-9078-8df51467fc8f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:46:21.534907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 593/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:46:21 2022] GET /identity/v3/role_assignments?user.id=3ce07c492c3340f6b248bfd91fc4c251&scope.project.id=3b6275a157f04f24948c1906f3e7124e&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:46:31.380089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=59 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:31.532779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=53 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:33.389855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af581-e987-49d5-bf0c-61acccc75f6a None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:33.390411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af581-e987-49d5-bf0c-61acccc75f6a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:33.390411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af581-e987-49d5-bf0c-61acccc75f6a None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:33.391835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 608/1201] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:33.397129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7969872-83b4-4ea1-a005-6c99c9222147 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:33.397615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7969872-83b4-4ea1-a005-6c99c9222147 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:33.397802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7969872-83b4-4ea1-a005-6c99c9222147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:33.416592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a7969872-83b4-4ea1-a005-6c99c9222147 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:33.417787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a7969872-83b4-4ea1-a005-6c99c9222147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:33.486352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 594/1202] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:47:33.759125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af581-e987-49d5-bf0c-61acccc75f6a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:33.858593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af581-e987-49d5-bf0c-61acccc75f6a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:33.890555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3586a-2185-457d-908c-dd60ebf2c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:33.891165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3586a-2185-457d-908c-dd60ebf2c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:33.891983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3586a-2185-457d-908c-dd60ebf2c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:33.892281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3586a-2185-457d-908c-dd60ebf2c6c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:33.901893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3586a-2185-457d-908c-dd60ebf2c6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:33.903412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3586a-2185-457d-908c-dd60ebf2c6c9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-fbd3586a-2185-457d-908c-dd60ebf2c6c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:33.919065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:33.920391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:33.921402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:33.921402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:33.921402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:33.921402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 609/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:33.926640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7969872-83b4-4ea1-a005-6c99c9222147 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:34.022893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7969872-83b4-4ea1-a005-6c99c9222147 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:34.052114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:34.057737 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807feec3-d827-4991-bfcd-4fe58bb607f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:34.058335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807feec3-d827-4991-bfcd-4fe58bb607f9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:34.058609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807feec3-d827-4991-bfcd-4fe58bb607f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:34.058874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807feec3-d827-4991-bfcd-4fe58bb607f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:34.059500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807feec3-d827-4991-bfcd-4fe58bb607f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:34.059795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807feec3-d827-4991-bfcd-4fe58bb607f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:34.061152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807feec3-d827-4991-bfcd-4fe58bb607f9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:34.072653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 595/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:47:34.078502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3586a-2185-457d-908c-dd60ebf2c6c9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:34.131031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:34.177549 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3586a-2185-457d-908c-dd60ebf2c6c9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:34.211207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b9f13-edf6-441e-b8bd-2e423ba89c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:34.211811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b9f13-edf6-441e-b8bd-2e423ba89c59 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:34.212089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b9f13-edf6-441e-b8bd-2e423ba89c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:34.212359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b9f13-edf6-441e-b8bd-2e423ba89c59 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:34.213005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b9f13-edf6-441e-b8bd-2e423ba89c59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:34.214516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b9f13-edf6-441e-b8bd-2e423ba89c59 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:34.327239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 610/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 07:47:34 2022] POST /identity/v3/users => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:47:36.280539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c7d97-a73d-4434-9873-54300147982d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:36.281091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c7d97-a73d-4434-9873-54300147982d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:36.281091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c7d97-a73d-4434-9873-54300147982d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:36.282511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 596/1206] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:36.288033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450d98-4041-4534-9b9b-20a44cd0bb52 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:36.288460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450d98-4041-4534-9b9b-20a44cd0bb52 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:36.293136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff450d98-4041-4534-9b9b-20a44cd0bb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:36.306692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ff450d98-4041-4534-9b9b-20a44cd0bb52 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:36.307903 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ff450d98-4041-4534-9b9b-20a44cd0bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:36.375385 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 611/1207] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:47:36.648931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c7d97-a73d-4434-9873-54300147982d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:36.754691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c7d97-a73d-4434-9873-54300147982d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:36.787691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91da8-e91f-4788-937c-221c7618ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:36.788314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91da8-e91f-4788-937c-221c7618ae14 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:36.788580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91da8-e91f-4788-937c-221c7618ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:36.788845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91da8-e91f-4788-937c-221c7618ae14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:36.799315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef91da8-e91f-4788-937c-221c7618ae14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-2ef91da8-e91f-4788-937c-221c7618ae14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:47:36.803944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:36.805096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:36.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 597/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:47:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:36.811184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff450d98-4041-4534-9b9b-20a44cd0bb52 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:36.849691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:36.908552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff450d98-4041-4534-9b9b-20a44cd0bb52 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:36.941728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b579f5-10cb-4144-9edd-2b8f422b1619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:36.942326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b579f5-10cb-4144-9edd-2b8f422b1619 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:36.942605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b579f5-10cb-4144-9edd-2b8f422b1619 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:36.942878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b579f5-10cb-4144-9edd-2b8f422b1619 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:36.943538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b579f5-10cb-4144-9edd-2b8f422b1619 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:36.943840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b579f5-10cb-4144-9edd-2b8f422b1619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:36.945197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b579f5-10cb-4144-9edd-2b8f422b1619 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:36.952839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 612/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:47:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:36.959057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91da8-e91f-4788-937c-221c7618ae14 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:37.009692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:37.057867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91da8-e91f-4788-937c-221c7618ae14 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:37.090780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2f03c-11b3-4721-9228-cad2119a1ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:37.091433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2f03c-11b3-4721-9228-cad2119a1ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:37.091907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2f03c-11b3-4721-9228-cad2119a1ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:37.092391 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2f03c-11b3-4721-9228-cad2119a1ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:37.103450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2f03c-11b3-4721-9228-cad2119a1ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:37.113422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2f03c-11b3-4721-9228-cad2119a1ec5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f5a2f03c-11b3-4721-9228-cad2119a1ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:37.119723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:37.120847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:37.122018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:37.122018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:37.122018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:37.122018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 598/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:37.127025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b579f5-10cb-4144-9edd-2b8f422b1619 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:37.224687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:37.227530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b579f5-10cb-4144-9edd-2b8f422b1619 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:37.260825 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fd2e1-d1a9-41db-84b9-f7fd97357f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:37.261426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fd2e1-d1a9-41db-84b9-f7fd97357f2b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:37.261741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fd2e1-d1a9-41db-84b9-f7fd97357f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:37.262014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fd2e1-d1a9-41db-84b9-f7fd97357f2b None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:37.262650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fd2e1-d1a9-41db-84b9-f7fd97357f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:37.262970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fd2e1-d1a9-41db-84b9-f7fd97357f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:37.264322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fd2e1-d1a9-41db-84b9-f7fd97357f2b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:37.275515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 613/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:37.281633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2f03c-11b3-4721-9228-cad2119a1ec5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:37.382542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2f03c-11b3-4721-9228-cad2119a1ec5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:37.384070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:37.416813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf75b7-6d78-4a1a-8f22-4a898dfc6a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:37.417421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf75b7-6d78-4a1a-8f22-4a898dfc6a02 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:37.417720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf75b7-6d78-4a1a-8f22-4a898dfc6a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:37.417987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf75b7-6d78-4a1a-8f22-4a898dfc6a02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:37.424721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf75b7-6d78-4a1a-8f22-4a898dfc6a02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:37.426171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf75b7-6d78-4a1a-8f22-4a898dfc6a02 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-12cf75b7-6d78-4a1a-8f22-4a898dfc6a02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:47:37.437051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:37.447339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:37.448397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 599/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:37.449043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fd2e1-d1a9-41db-84b9-f7fd97357f2b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:37.545067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fd2e1-d1a9-41db-84b9-f7fd97357f2b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:37.577195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c0a81-4ad2-40ac-9c7b-728edcb7c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:37.577816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c0a81-4ad2-40ac-9c7b-728edcb7c63d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:37.580509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c0a81-4ad2-40ac-9c7b-728edcb7c63d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:37.580509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c0a81-4ad2-40ac-9c7b-728edcb7c63d None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:37.580509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c0a81-4ad2-40ac-9c7b-728edcb7c63d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:37.580509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c0a81-4ad2-40ac-9c7b-728edcb7c63d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:37.581259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c0a81-4ad2-40ac-9c7b-728edcb7c63d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:37.598526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 614/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 07:47:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:37.604330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf75b7-6d78-4a1a-8f22-4a898dfc6a02 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:37.701099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf75b7-6d78-4a1a-8f22-4a898dfc6a02 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:37.734840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67720d-8381-484f-9806-e080520cc25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:37.735691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67720d-8381-484f-9806-e080520cc25e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:37.736000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67720d-8381-484f-9806-e080520cc25e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:37.736316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67720d-8381-484f-9806-e080520cc25e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:37.765356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:37.805040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67720d-8381-484f-9806-e080520cc25e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:37.806980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67720d-8381-484f-9806-e080520cc25e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:37.904709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 600/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:47:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:47:37.910762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c0a81-4ad2-40ac-9c7b-728edcb7c63d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:37.929239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:38.009188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c0a81-4ad2-40ac-9c7b-728edcb7c63d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:38.042971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8b7e-b5ef-4064-bfdf-210ca95db152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:38.043597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8b7e-b5ef-4064-bfdf-210ca95db152 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:38.043873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8b7e-b5ef-4064-bfdf-210ca95db152 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:38.044143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8b7e-b5ef-4064-bfdf-210ca95db152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:38.054165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8b7e-b5ef-4064-bfdf-210ca95db152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:38.055689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8b7e-b5ef-4064-bfdf-210ca95db152 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1e1b8b7e-b5ef-4064-bfdf-210ca95db152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:38.070717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:38.082220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:38.083268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:38.083268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:38.083268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:38.083268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 615/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:38.083534 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67720d-8381-484f-9806-e080520cc25e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:38.137860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:38.176527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67720d-8381-484f-9806-e080520cc25e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:38.210209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dbcc7-1c41-4f6b-b631-563a988e358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:38.210804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dbcc7-1c41-4f6b-b631-563a988e358a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:38.211128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dbcc7-1c41-4f6b-b631-563a988e358a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:38.211416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dbcc7-1c41-4f6b-b631-563a988e358a None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:38.212249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dbcc7-1c41-4f6b-b631-563a988e358a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:38.212703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dbcc7-1c41-4f6b-b631-563a988e358a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:38.214562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dbcc7-1c41-4f6b-b631-563a988e358a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:38.227034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 601/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:38.232720 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8b7e-b5ef-4064-bfdf-210ca95db152 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:38.303381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:38.335171 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8b7e-b5ef-4064-bfdf-210ca95db152 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:38.369629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ee05d-5369-4b9a-bba3-c33524e59820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:38.370259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ee05d-5369-4b9a-bba3-c33524e59820 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:38.370537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ee05d-5369-4b9a-bba3-c33524e59820 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:38.370829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ee05d-5369-4b9a-bba3-c33524e59820 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:38.377836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ee05d-5369-4b9a-bba3-c33524e59820 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:38.379267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ee05d-5369-4b9a-bba3-c33524e59820 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7f5ee05d-5369-4b9a-bba3-c33524e59820 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:47:38.390368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:38.391795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:38.392706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:47:38.392706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:47:38.392706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:47:38.392706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:47:38.392706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:47:38.392706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:47:38.392706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:38.392706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:38.392706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 616/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:47:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:38.398043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dbcc7-1c41-4f6b-b631-563a988e358a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:38.495865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dbcc7-1c41-4f6b-b631-563a988e358a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:38.520754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:38.532079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1825591-6b78-4695-97ae-9d35956d4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:38.532675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825591-6b78-4695-97ae-9d35956d4a12 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:38.532950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825591-6b78-4695-97ae-9d35956d4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:38.533215 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825591-6b78-4695-97ae-9d35956d4a12 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:38.533958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825591-6b78-4695-97ae-9d35956d4a12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:38.534258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825591-6b78-4695-97ae-9d35956d4a12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:38.535673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825591-6b78-4695-97ae-9d35956d4a12 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:38.546907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 602/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:47:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:38.553066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ee05d-5369-4b9a-bba3-c33524e59820 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:38.656233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ee05d-5369-4b9a-bba3-c33524e59820 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:38.683210 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:38.689689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b348a2-dbf9-4802-a9f0-1d0a7953ddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:38.690281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b348a2-dbf9-4802-a9f0-1d0a7953ddd4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:38.690555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b348a2-dbf9-4802-a9f0-1d0a7953ddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:38.690819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b348a2-dbf9-4802-a9f0-1d0a7953ddd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:38.691583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b348a2-dbf9-4802-a9f0-1d0a7953ddd4 None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=00093949026746f29def86e4a0b48bf0) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:38.691878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b348a2-dbf9-4802-a9f0-1d0a7953ddd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:38.693298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b348a2-dbf9-4802-a9f0-1d0a7953ddd4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:38.698527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 617/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:47:38 2022] GET /identity/v3/role_assignments?user.id=00093949026746f29def86e4a0b48bf0&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:40.575286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3e17-0c0f-4697-8cf4-2dc8d0585d46 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:40.575840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3e17-0c0f-4697-8cf4-2dc8d0585d46 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:40.575840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3e17-0c0f-4697-8cf4-2dc8d0585d46 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:40.577250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 603/1220] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:40.583174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afbb5-76a0-4129-a4e7-1b71f7e3a835 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:40.583605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afbb5-76a0-4129-a4e7-1b71f7e3a835 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:40.583740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afbb5-76a0-4129-a4e7-1b71f7e3a835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:40.602973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-640afbb5-76a0-4129-a4e7-1b71f7e3a835 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:40.604161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-640afbb5-76a0-4129-a4e7-1b71f7e3a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:40.670711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 618/1221] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:47:40.941306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3e17-0c0f-4697-8cf4-2dc8d0585d46 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:41.043449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3e17-0c0f-4697-8cf4-2dc8d0585d46 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:41.076122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cd26e-fdb1-4a8e-83c5-d75bb77d4b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:41.076735 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cd26e-fdb1-4a8e-83c5-d75bb77d4b91 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:41.077003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cd26e-fdb1-4a8e-83c5-d75bb77d4b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:41.077267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cd26e-fdb1-4a8e-83c5-d75bb77d4b91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:41.087958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cd26e-fdb1-4a8e-83c5-d75bb77d4b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ed5cd26e-fdb1-4a8e-83c5-d75bb77d4b91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:47:41.092569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:41.093793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:41.094962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 604/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:47:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:41.100336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afbb5-76a0-4129-a4e7-1b71f7e3a835 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:41.198452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afbb5-76a0-4129-a4e7-1b71f7e3a835 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:41.222976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:41.233188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ecf88-158c-4047-bf6e-6728490c4ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:41.233821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ecf88-158c-4047-bf6e-6728490c4ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:41.234105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ecf88-158c-4047-bf6e-6728490c4ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:41.234373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ecf88-158c-4047-bf6e-6728490c4ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:41.235031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ecf88-158c-4047-bf6e-6728490c4ff1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:41.235324 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ecf88-158c-4047-bf6e-6728490c4ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:41.236786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ecf88-158c-4047-bf6e-6728490c4ff1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:41.244382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 619/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:47:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:41.250082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cd26e-fdb1-4a8e-83c5-d75bb77d4b91 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:41.293262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:41.347879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cd26e-fdb1-4a8e-83c5-d75bb77d4b91 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:41.380553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f18ccd-01d4-4e2b-a60d-9b37907793de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:41.381175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18ccd-01d4-4e2b-a60d-9b37907793de None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:41.381450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18ccd-01d4-4e2b-a60d-9b37907793de None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:41.381746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f18ccd-01d4-4e2b-a60d-9b37907793de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:41.392289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f18ccd-01d4-4e2b-a60d-9b37907793de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:41.393777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f18ccd-01d4-4e2b-a60d-9b37907793de None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-89f18ccd-01d4-4e2b-a60d-9b37907793de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:41.408292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:41.409438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:41.410384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:41.410384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:41.410384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:41.410384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 605/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:41.415506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ecf88-158c-4047-bf6e-6728490c4ff1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:41.514011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ecf88-158c-4047-bf6e-6728490c4ff1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:41.548255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42a7a0-ee6e-41b4-9ff6-4684c46f1a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:41.548859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42a7a0-ee6e-41b4-9ff6-4684c46f1a19 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:41.549138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42a7a0-ee6e-41b4-9ff6-4684c46f1a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:41.549406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42a7a0-ee6e-41b4-9ff6-4684c46f1a19 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:41.550075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42a7a0-ee6e-41b4-9ff6-4684c46f1a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:41.550372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42a7a0-ee6e-41b4-9ff6-4684c46f1a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:41.551721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42a7a0-ee6e-41b4-9ff6-4684c46f1a19 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:41.564123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 620/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:41.569713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f18ccd-01d4-4e2b-a60d-9b37907793de None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:41.662087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:41.668336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f18ccd-01d4-4e2b-a60d-9b37907793de None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:41.701332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c80f4-020d-47c1-84e8-5bf4df01239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:41.702044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c80f4-020d-47c1-84e8-5bf4df01239e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:41.702347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c80f4-020d-47c1-84e8-5bf4df01239e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:41.702616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c80f4-020d-47c1-84e8-5bf4df01239e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:41.710371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c80f4-020d-47c1-84e8-5bf4df01239e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:41.712171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c80f4-020d-47c1-84e8-5bf4df01239e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-645c80f4-020d-47c1-84e8-5bf4df01239e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:47:41.723155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:41.724148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:41.725266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 606/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:41.730176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42a7a0-ee6e-41b4-9ff6-4684c46f1a19 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:41.776951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:41.831748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42a7a0-ee6e-41b4-9ff6-4684c46f1a19 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:41.865665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e832-37f1-4fd1-b4d6-97f2e896b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:41.866265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e832-37f1-4fd1-b4d6-97f2e896b157 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:41.866540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e832-37f1-4fd1-b4d6-97f2e896b157 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:41.866807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e832-37f1-4fd1-b4d6-97f2e896b157 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:41.867526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186e832-37f1-4fd1-b4d6-97f2e896b157 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:41.867827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186e832-37f1-4fd1-b4d6-97f2e896b157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:41.869276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186e832-37f1-4fd1-b4d6-97f2e896b157 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:41.886509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 621/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 07:47:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:41.892664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c80f4-020d-47c1-84e8-5bf4df01239e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:41.989618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c80f4-020d-47c1-84e8-5bf4df01239e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:42.021986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b0e4f-cf01-4ba4-a174-48ba835e9b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:42.022592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0e4f-cf01-4ba4-a174-48ba835e9b6b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:42.022863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0e4f-cf01-4ba4-a174-48ba835e9b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:42.023125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0e4f-cf01-4ba4-a174-48ba835e9b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:42.036356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b0e4f-cf01-4ba4-a174-48ba835e9b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:42.037751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b0e4f-cf01-4ba4-a174-48ba835e9b6b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-607b0e4f-cf01-4ba4-a174-48ba835e9b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:42.052138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:42.053276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:42.054258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:42.054258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:42.054258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:42.054258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 607/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:47:42.059139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e832-37f1-4fd1-b4d6-97f2e896b157 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:42.157115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e832-37f1-4fd1-b4d6-97f2e896b157 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:42.159556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:42.191592 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4bc7a-1215-4eb6-9f2a-c631b123ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:42.192194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4bc7a-1215-4eb6-9f2a-c631b123ed39 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:42.192467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4bc7a-1215-4eb6-9f2a-c631b123ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:42.192735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4bc7a-1215-4eb6-9f2a-c631b123ed39 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:42.193530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4bc7a-1215-4eb6-9f2a-c631b123ed39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:42.193832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4bc7a-1215-4eb6-9f2a-c631b123ed39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:42.195196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4bc7a-1215-4eb6-9f2a-c631b123ed39 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:42.206413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 622/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:42.212161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b0e4f-cf01-4ba4-a174-48ba835e9b6b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:42.222540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:42.311255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b0e4f-cf01-4ba4-a174-48ba835e9b6b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:42.346688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee0805-6462-463e-b63b-0052176d77ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:42.347312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee0805-6462-463e-b63b-0052176d77ee None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:42.347586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee0805-6462-463e-b63b-0052176d77ee None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:42.347879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee0805-6462-463e-b63b-0052176d77ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:42.354205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee0805-6462-463e-b63b-0052176d77ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:42.359414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee0805-6462-463e-b63b-0052176d77ee None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-62ee0805-6462-463e-b63b-0052176d77ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:47:42.367035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:42.368127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:42.369218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:47:42.369218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:47:42.369218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:47:42.369218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:47:42.369218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:47:42.369218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:47:42.369218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:42.369218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:42.369218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 608/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:47:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:42.374008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4bc7a-1215-4eb6-9f2a-c631b123ed39 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:42.474726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4bc7a-1215-4eb6-9f2a-c631b123ed39 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:42.507639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0305bfc-cf78-43d7-a2c2-ec86369ff03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:42.508236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0305bfc-cf78-43d7-a2c2-ec86369ff03b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:42.508514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0305bfc-cf78-43d7-a2c2-ec86369ff03b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:42.508785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0305bfc-cf78-43d7-a2c2-ec86369ff03b None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:42.509495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0305bfc-cf78-43d7-a2c2-ec86369ff03b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:42.509805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0305bfc-cf78-43d7-a2c2-ec86369ff03b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:42.511231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0305bfc-cf78-43d7-a2c2-ec86369ff03b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:42.523947 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 623/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:47:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:42.530203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee0805-6462-463e-b63b-0052176d77ee None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:42.596791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:42.631450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee0805-6462-463e-b63b-0052176d77ee None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:42.663500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a4b61-e7a3-4d75-9a6c-d2f10c9fcef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:42.664147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4b61-e7a3-4d75-9a6c-d2f10c9fcef1 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:42.664420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4b61-e7a3-4d75-9a6c-d2f10c9fcef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:42.664688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4b61-e7a3-4d75-9a6c-d2f10c9fcef1 None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/00093949026746f29def86e4a0b48bf0/roles/812d9626de92430d9cef17f80d5a1b4e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:42.678921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a4b61-e7a3-4d75-9a6c-d2f10c9fcef1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=00093949026746f29def86e4a0b48bf0, role_id=812d9626de92430d9cef17f80d5a1b4e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:42.680385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a4b61-e7a3-4d75-9a6c-d2f10c9fcef1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:42.783118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 609/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:47:42 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/00093949026746f29def86e4a0b48bf0/roles/812d9626de92430d9cef17f80d5a1b4e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:47:44.697042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924442de-2cc6-4d3c-be24-f93e35d7bd12 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:44.697665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924442de-2cc6-4d3c-be24-f93e35d7bd12 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:44.697665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924442de-2cc6-4d3c-be24-f93e35d7bd12 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:44.698879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 624/1233] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:44.704866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7baf64-bee2-48dc-95e3-88ead1c26968 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:44.705314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7baf64-bee2-48dc-95e3-88ead1c26968 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:44.705436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7baf64-bee2-48dc-95e3-88ead1c26968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:44.723140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4b7baf64-bee2-48dc-95e3-88ead1c26968 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:44.724403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4b7baf64-bee2-48dc-95e3-88ead1c26968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:44.790526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 610/1234] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:47:45.067118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924442de-2cc6-4d3c-be24-f93e35d7bd12 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:45.093105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:45.172709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924442de-2cc6-4d3c-be24-f93e35d7bd12 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:45.206902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596c8ac-e4b0-48a9-b8ac-bf0f1f13dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:45.207518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596c8ac-e4b0-48a9-b8ac-bf0f1f13dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:45.207791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596c8ac-e4b0-48a9-b8ac-bf0f1f13dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:45.208057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596c8ac-e4b0-48a9-b8ac-bf0f1f13dfa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:45.218365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596c8ac-e4b0-48a9-b8ac-bf0f1f13dfa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-0596c8ac-e4b0-48a9-b8ac-bf0f1f13dfa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:47:45.223709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:45.224936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:45.226127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 625/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 07:47:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:45.230890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7baf64-bee2-48dc-95e3-88ead1c26968 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:45.277558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:45.333042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7baf64-bee2-48dc-95e3-88ead1c26968 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:45.366417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa557779-9865-4f8e-afca-3d1dd52e6fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:45.367021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557779-9865-4f8e-afca-3d1dd52e6fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:45.367296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557779-9865-4f8e-afca-3d1dd52e6fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:45.367564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa557779-9865-4f8e-afca-3d1dd52e6fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:45.368217 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa557779-9865-4f8e-afca-3d1dd52e6fb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:45.368515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa557779-9865-4f8e-afca-3d1dd52e6fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:45.369898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa557779-9865-4f8e-afca-3d1dd52e6fb3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:45.380112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 611/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 07:47:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:45.391701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596c8ac-e4b0-48a9-b8ac-bf0f1f13dfa0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:45.472303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:45.487633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596c8ac-e4b0-48a9-b8ac-bf0f1f13dfa0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:45.521571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5192c-2921-41c9-b5df-9aa314437f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:45.522186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5192c-2921-41c9-b5df-9aa314437f92 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:45.522457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5192c-2921-41c9-b5df-9aa314437f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:45.522722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5192c-2921-41c9-b5df-9aa314437f92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:45.533094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5192c-2921-41c9-b5df-9aa314437f92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:45.534622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5192c-2921-41c9-b5df-9aa314437f92 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-c8b5192c-2921-41c9-b5df-9aa314437f92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:45.548698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:45.549912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:45.550852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:45.550852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:45.550852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:45.550852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 626/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:45.555747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa557779-9865-4f8e-afca-3d1dd52e6fb3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:45.657916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa557779-9865-4f8e-afca-3d1dd52e6fb3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:45.666320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:45.691059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ba47c-a964-4c73-875a-9dc1e3f05137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:45.691664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ba47c-a964-4c73-875a-9dc1e3f05137 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:45.691938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ba47c-a964-4c73-875a-9dc1e3f05137 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:45.692209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ba47c-a964-4c73-875a-9dc1e3f05137 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:45.692844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ba47c-a964-4c73-875a-9dc1e3f05137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:45.693141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ba47c-a964-4c73-875a-9dc1e3f05137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:45.694554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ba47c-a964-4c73-875a-9dc1e3f05137 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:45.706325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 612/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:45.712069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5192c-2921-41c9-b5df-9aa314437f92 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:45.814485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5192c-2921-41c9-b5df-9aa314437f92 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:45.846923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df4ccd-5a09-4e01-be3e-831c2a6898fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:45.847542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df4ccd-5a09-4e01-be3e-831c2a6898fd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:45.847816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df4ccd-5a09-4e01-be3e-831c2a6898fd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:45.848081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df4ccd-5a09-4e01-be3e-831c2a6898fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:45.850747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:45.855585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df4ccd-5a09-4e01-be3e-831c2a6898fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:45.857014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df4ccd-5a09-4e01-be3e-831c2a6898fd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d5df4ccd-5a09-4e01-be3e-831c2a6898fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:47:45.868237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:45.874147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:45.875953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 627/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:45.877992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ba47c-a964-4c73-875a-9dc1e3f05137 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:45.980500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ba47c-a964-4c73-875a-9dc1e3f05137 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:46.012215 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c7ebf-966a-4b91-8235-95f8ca2d4559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:46.012815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c7ebf-966a-4b91-8235-95f8ca2d4559 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.013091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c7ebf-966a-4b91-8235-95f8ca2d4559 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.013359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c7ebf-966a-4b91-8235-95f8ca2d4559 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.014109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c7ebf-966a-4b91-8235-95f8ca2d4559 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:46.014412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c7ebf-966a-4b91-8235-95f8ca2d4559 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:46.015829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c7ebf-966a-4b91-8235-95f8ca2d4559 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:46.033773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 613/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 07:47:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:46.039876 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df4ccd-5a09-4e01-be3e-831c2a6898fd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:46.141384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df4ccd-5a09-4e01-be3e-831c2a6898fd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:46.175533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f027-c854-4ea3-a3d2-69bc81fa4409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:46.176134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f027-c854-4ea3-a3d2-69bc81fa4409 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.176409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f027-c854-4ea3-a3d2-69bc81fa4409 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.176677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526f027-c854-4ea3-a3d2-69bc81fa4409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.238397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:46.244671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526f027-c854-4ea3-a3d2-69bc81fa4409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:46.246154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526f027-c854-4ea3-a3d2-69bc81fa4409 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:46.340502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 628/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:47:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:47:46.346883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c7ebf-966a-4b91-8235-95f8ca2d4559 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:46.373183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:46.442919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c7ebf-966a-4b91-8235-95f8ca2d4559 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:46.476223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de0b4e-70b1-41ba-a74d-573dd1cc8f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:46.476841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de0b4e-70b1-41ba-a74d-573dd1cc8f86 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.477114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de0b4e-70b1-41ba-a74d-573dd1cc8f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.477383 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de0b4e-70b1-41ba-a74d-573dd1cc8f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.488041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de0b4e-70b1-41ba-a74d-573dd1cc8f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:46.489538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de0b4e-70b1-41ba-a74d-573dd1cc8f86 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-16de0b4e-70b1-41ba-a74d-573dd1cc8f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:46.504701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:46.505932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:46.507101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:46.507101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:46.507101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:46.507101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 614/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:46.511579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f027-c854-4ea3-a3d2-69bc81fa4409 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:46.602483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:46.608221 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526f027-c854-4ea3-a3d2-69bc81fa4409 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:46.643119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d72abe-599b-4ce7-92c7-ca6e2fa98c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:46.644777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d72abe-599b-4ce7-92c7-ca6e2fa98c9c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.644777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d72abe-599b-4ce7-92c7-ca6e2fa98c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.644777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d72abe-599b-4ce7-92c7-ca6e2fa98c9c None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.645143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d72abe-599b-4ce7-92c7-ca6e2fa98c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:46.645442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d72abe-599b-4ce7-92c7-ca6e2fa98c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:46.646857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d72abe-599b-4ce7-92c7-ca6e2fa98c9c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:46.658328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 629/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:46.664124 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de0b4e-70b1-41ba-a74d-573dd1cc8f86 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:46.743113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:46.763382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de0b4e-70b1-41ba-a74d-573dd1cc8f86 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:46.801119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb860f1-e7c8-4323-9b2a-15ad5b167bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:46.801769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb860f1-e7c8-4323-9b2a-15ad5b167bdb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.802046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb860f1-e7c8-4323-9b2a-15ad5b167bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.802313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb860f1-e7c8-4323-9b2a-15ad5b167bdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.810869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb860f1-e7c8-4323-9b2a-15ad5b167bdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:46.816645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb860f1-e7c8-4323-9b2a-15ad5b167bdb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6cb860f1-e7c8-4323-9b2a-15ad5b167bdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:47:46.824918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:46.826096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:46.827036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:47:46.827036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:47:46.827036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:47:46.827036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:47:46.827036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:47:46.827036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:47:46.827036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:46.827036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:46.827036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 615/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:47:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:46.832063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d72abe-599b-4ce7-92c7-ca6e2fa98c9c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:46.933264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d72abe-599b-4ce7-92c7-ca6e2fa98c9c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:46.966317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7145c-cd98-4f16-8cc6-1d5a499ce937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:46.966913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7145c-cd98-4f16-8cc6-1d5a499ce937 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:46.967190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7145c-cd98-4f16-8cc6-1d5a499ce937 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:46.967462 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7145c-cd98-4f16-8cc6-1d5a499ce937 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:46.968140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7145c-cd98-4f16-8cc6-1d5a499ce937 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:46.968440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7145c-cd98-4f16-8cc6-1d5a499ce937 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:46.970908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7145c-cd98-4f16-8cc6-1d5a499ce937 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:46.982604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 630/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:47:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:46.989354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb860f1-e7c8-4323-9b2a-15ad5b167bdb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:47.089410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb860f1-e7c8-4323-9b2a-15ad5b167bdb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:47.123188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ef971-31da-414a-be39-41d7ce6a4b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:47.123787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef971-31da-414a-be39-41d7ce6a4b54 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:47.124061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef971-31da-414a-be39-41d7ce6a4b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:47.124329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef971-31da-414a-be39-41d7ce6a4b54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:47.125050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ef971-31da-414a-be39-41d7ce6a4b54 None admin] RBAC: Adding query filter params (role.id=812d9626de92430d9cef17f80d5a1b4e, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=00093949026746f29def86e4a0b48bf0) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:47.125415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ef971-31da-414a-be39-41d7ce6a4b54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:47.126872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ef971-31da-414a-be39-41d7ce6a4b54 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:47.132469 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 616/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:47:46 2022] GET /identity/v3/role_assignments?user.id=00093949026746f29def86e4a0b48bf0&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=812d9626de92430d9cef17f80d5a1b4e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:49.098738 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af7e8-0799-4fd8-abf4-db8aeacc65cc None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:49.099298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af7e8-0799-4fd8-abf4-db8aeacc65cc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:49.099298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af7e8-0799-4fd8-abf4-db8aeacc65cc None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:49.100620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 631/1247] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:49.105923 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40506d4-4bc4-4287-9b33-0acac0046871 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:49.106313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40506d4-4bc4-4287-9b33-0acac0046871 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:49.106512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40506d4-4bc4-4287-9b33-0acac0046871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:49.113129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:49.124647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d40506d4-4bc4-4287-9b33-0acac0046871 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:49.134109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d40506d4-4bc4-4287-9b33-0acac0046871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:49.192436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 617/1248] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:47:49.465638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3af7e8-0799-4fd8-abf4-db8aeacc65cc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:49.483671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:49.566072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3af7e8-0799-4fd8-abf4-db8aeacc65cc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:49.597706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454f96-b051-4e35-9b19-13ed8767c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:49.598319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454f96-b051-4e35-9b19-13ed8767c275 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:49.598591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454f96-b051-4e35-9b19-13ed8767c275 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:49.598856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454f96-b051-4e35-9b19-13ed8767c275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:49.608959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34454f96-b051-4e35-9b19-13ed8767c275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-34454f96-b051-4e35-9b19-13ed8767c275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:47:49.615300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:49.616492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:49.617612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 632/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:49.622916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40506d4-4bc4-4287-9b33-0acac0046871 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:49.726060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40506d4-4bc4-4287-9b33-0acac0046871 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:49.755708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:49.760476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67bad3-7613-4e5a-9eaa-168dc063ae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:49.761082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67bad3-7613-4e5a-9eaa-168dc063ae79 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:49.761357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67bad3-7613-4e5a-9eaa-168dc063ae79 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:49.761654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67bad3-7613-4e5a-9eaa-168dc063ae79 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:49.762316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67bad3-7613-4e5a-9eaa-168dc063ae79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:49.762611 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67bad3-7613-4e5a-9eaa-168dc063ae79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:49.763993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67bad3-7613-4e5a-9eaa-168dc063ae79 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:49.772586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 618/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:49.778762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454f96-b051-4e35-9b19-13ed8767c275 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:49.857876 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:49.881333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454f96-b051-4e35-9b19-13ed8767c275 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:49.915357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2ba0d-3148-47bd-88c1-adf8c5eea0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:49.915976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2ba0d-3148-47bd-88c1-adf8c5eea0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:49.916247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2ba0d-3148-47bd-88c1-adf8c5eea0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:49.916511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2ba0d-3148-47bd-88c1-adf8c5eea0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:49.927741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2ba0d-3148-47bd-88c1-adf8c5eea0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:49.929177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2ba0d-3148-47bd-88c1-adf8c5eea0a8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-3be2ba0d-3148-47bd-88c1-adf8c5eea0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:49.943782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:49.945106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:49.946541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:49.946541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:49.946541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:49.946541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 633/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:49.951089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67bad3-7613-4e5a-9eaa-168dc063ae79 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:50.083179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67bad3-7613-4e5a-9eaa-168dc063ae79 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:50.116854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289d680-4d45-43ff-9b38-3e352b9d5785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:50.117557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289d680-4d45-43ff-9b38-3e352b9d5785 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:50.117740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289d680-4d45-43ff-9b38-3e352b9d5785 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:50.118007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289d680-4d45-43ff-9b38-3e352b9d5785 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:50.118635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289d680-4d45-43ff-9b38-3e352b9d5785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:50.118932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289d680-4d45-43ff-9b38-3e352b9d5785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:50.120355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289d680-4d45-43ff-9b38-3e352b9d5785 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:50.133483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 619/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:50.139210 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2ba0d-3148-47bd-88c1-adf8c5eea0a8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:50.250232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2ba0d-3148-47bd-88c1-adf8c5eea0a8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:50.278168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:50.289052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764715b-9876-4bc6-b9ec-76017ce3b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:50.289716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764715b-9876-4bc6-b9ec-76017ce3b6cb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:50.289993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764715b-9876-4bc6-b9ec-76017ce3b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:50.290273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764715b-9876-4bc6-b9ec-76017ce3b6cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:50.300713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764715b-9876-4bc6-b9ec-76017ce3b6cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:50.308203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764715b-9876-4bc6-b9ec-76017ce3b6cb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4764715b-9876-4bc6-b9ec-76017ce3b6cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:47:50.314660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:50.320487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:50.321782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 634/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:50.322537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289d680-4d45-43ff-9b38-3e352b9d5785 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:50.385117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:50.432294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289d680-4d45-43ff-9b38-3e352b9d5785 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:50.465330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305fa7-8c6d-4a93-a711-1c7d9992fe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:50.465947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305fa7-8c6d-4a93-a711-1c7d9992fe37 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:50.466219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305fa7-8c6d-4a93-a711-1c7d9992fe37 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:50.466482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305fa7-8c6d-4a93-a711-1c7d9992fe37 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:50.467195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305fa7-8c6d-4a93-a711-1c7d9992fe37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:50.467490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305fa7-8c6d-4a93-a711-1c7d9992fe37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:50.469819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305fa7-8c6d-4a93-a711-1c7d9992fe37 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:50.486916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 620/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 07:47:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:50.492773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764715b-9876-4bc6-b9ec-76017ce3b6cb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:50.594028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764715b-9876-4bc6-b9ec-76017ce3b6cb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:50.626542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3355-764d-4b25-b66e-e92beb25eae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:50.627138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3355-764d-4b25-b66e-e92beb25eae8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:50.627409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3355-764d-4b25-b66e-e92beb25eae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:50.627674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3355-764d-4b25-b66e-e92beb25eae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:50.680829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:50.693000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b3355-764d-4b25-b66e-e92beb25eae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:50.694451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b3355-764d-4b25-b66e-e92beb25eae8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:50.794143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 635/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:47:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:47:50.800099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305fa7-8c6d-4a93-a711-1c7d9992fe37 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:50.902225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305fa7-8c6d-4a93-a711-1c7d9992fe37 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:50.916566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:50.937387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae0f3-3f45-447d-aaf0-8f039217e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:50.938616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae0f3-3f45-447d-aaf0-8f039217e648 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:50.938886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae0f3-3f45-447d-aaf0-8f039217e648 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:50.939150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae0f3-3f45-447d-aaf0-8f039217e648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:50.949193 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae0f3-3f45-447d-aaf0-8f039217e648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:50.950685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae0f3-3f45-447d-aaf0-8f039217e648 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7ecae0f3-3f45-447d-aaf0-8f039217e648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:50.964788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:50.965987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:50.967117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:50.967117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:50.967117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:50.967117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 621/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:50.971674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3355-764d-4b25-b66e-e92beb25eae8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:51.062140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:51.074634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3355-764d-4b25-b66e-e92beb25eae8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:51.109100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabda791-21dd-47f9-b980-d32160e6136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:51.110275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabda791-21dd-47f9-b980-d32160e6136f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:51.110706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabda791-21dd-47f9-b980-d32160e6136f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:51.110835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabda791-21dd-47f9-b980-d32160e6136f None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:51.111436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabda791-21dd-47f9-b980-d32160e6136f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:51.111732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabda791-21dd-47f9-b980-d32160e6136f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:51.113091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabda791-21dd-47f9-b980-d32160e6136f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:51.124065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 636/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:51.130642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae0f3-3f45-447d-aaf0-8f039217e648 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:51.233866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae0f3-3f45-447d-aaf0-8f039217e648 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:51.267392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20fca-565a-4bd5-8f48-f450365c772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:51.268008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20fca-565a-4bd5-8f48-f450365c772b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:51.268287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20fca-565a-4bd5-8f48-f450365c772b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:51.268598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20fca-565a-4bd5-8f48-f450365c772b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:51.275234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f20fca-565a-4bd5-8f48-f450365c772b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:51.278088 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f20fca-565a-4bd5-8f48-f450365c772b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-14f20fca-565a-4bd5-8f48-f450365c772b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:47:51.289001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:51.290233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:51.291162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:47:51.291162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:47:51.291162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:47:51.291162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:47:51.291162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:47:51.291162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:47:51.291162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:51.291162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:51.291162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 622/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:47:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:51.296135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabda791-21dd-47f9-b980-d32160e6136f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:51.402730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabda791-21dd-47f9-b980-d32160e6136f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:51.437261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5b7fc-81e0-48c4-b31a-d2af9dde0a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:51.438138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b7fc-81e0-48c4-b31a-d2af9dde0a61 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:51.438516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b7fc-81e0-48c4-b31a-d2af9dde0a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:51.438791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b7fc-81e0-48c4-b31a-d2af9dde0a61 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:51.439658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5b7fc-81e0-48c4-b31a-d2af9dde0a61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:51.439960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5b7fc-81e0-48c4-b31a-d2af9dde0a61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:51.441384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5b7fc-81e0-48c4-b31a-d2af9dde0a61 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:51.453756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 637/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:47:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:51.460056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20fca-565a-4bd5-8f48-f450365c772b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:51.486466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:51.558885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20fca-565a-4bd5-8f48-f450365c772b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:51.592548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38e606-03f6-4756-a787-271ff6b0f0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:51.593142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38e606-03f6-4756-a787-271ff6b0f0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:51.593416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38e606-03f6-4756-a787-271ff6b0f0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:51.593713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38e606-03f6-4756-a787-271ff6b0f0a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:51.595000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38e606-03f6-4756-a787-271ff6b0f0a1 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=00093949026746f29def86e4a0b48bf0) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:51.595305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38e606-03f6-4756-a787-271ff6b0f0a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:51.596725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38e606-03f6-4756-a787-271ff6b0f0a1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:51.602026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 623/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:47:51 2022] GET /identity/v3/role_assignments?user.id=00093949026746f29def86e4a0b48bf0&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:53.487536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f1b2b-fc4d-4839-989e-2cc529eb9206 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:53.488086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f1b2b-fc4d-4839-989e-2cc529eb9206 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:53.488086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f1b2b-fc4d-4839-989e-2cc529eb9206 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:53.489398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 638/1261] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:53.494615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b51a0-03d4-4585-a30e-168c4766debe None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:53.497057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b51a0-03d4-4585-a30e-168c4766debe None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:53.497057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b51a0-03d4-4585-a30e-168c4766debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:53.512670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ff4b51a0-03d4-4585-a30e-168c4766debe None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:53.513854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ff4b51a0-03d4-4585-a30e-168c4766debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:53.579872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 624/1262] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:47:53.847533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f1b2b-fc4d-4839-989e-2cc529eb9206 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:53.858384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:53.947255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f1b2b-fc4d-4839-989e-2cc529eb9206 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:53.981550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1ac8e-e050-41e5-a991-2669c1e13797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:53.982184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1ac8e-e050-41e5-a991-2669c1e13797 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:53.982443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1ac8e-e050-41e5-a991-2669c1e13797 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:53.982707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1ac8e-e050-41e5-a991-2669c1e13797 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:53.993215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1ac8e-e050-41e5-a991-2669c1e13797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-15a1ac8e-e050-41e5-a991-2669c1e13797 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:47:53.997945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:54.003726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:54.004779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 639/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:47:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:54.005657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b51a0-03d4-4585-a30e-168c4766debe None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:54.023747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:54.102559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b51a0-03d4-4585-a30e-168c4766debe None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:54.136327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92f4a5-b207-4a58-a52d-7b81c4fc3e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:54.136924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f4a5-b207-4a58-a52d-7b81c4fc3e28 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:54.137201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f4a5-b207-4a58-a52d-7b81c4fc3e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:54.137495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92f4a5-b207-4a58-a52d-7b81c4fc3e28 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:54.138192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92f4a5-b207-4a58-a52d-7b81c4fc3e28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:54.138523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92f4a5-b207-4a58-a52d-7b81c4fc3e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:54.140010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92f4a5-b207-4a58-a52d-7b81c4fc3e28 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:54.148485 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 625/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:47:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:47:54.154326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1ac8e-e050-41e5-a991-2669c1e13797 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:54.223139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:54.255563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1ac8e-e050-41e5-a991-2669c1e13797 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:54.289093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5b0c-d54e-4fcb-a36d-95229afdc4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:54.289839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5b0c-d54e-4fcb-a36d-95229afdc4db None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:54.290111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5b0c-d54e-4fcb-a36d-95229afdc4db None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:54.290375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5b0c-d54e-4fcb-a36d-95229afdc4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:54.300363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a5b0c-d54e-4fcb-a36d-95229afdc4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:54.301821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a5b0c-d54e-4fcb-a36d-95229afdc4db None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ea2a5b0c-d54e-4fcb-a36d-95229afdc4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:54.316179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:54.317215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:54.318216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:54.318216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:54.318216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:54.318216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 640/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:54.323428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92f4a5-b207-4a58-a52d-7b81c4fc3e28 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:54.404537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:54.423277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92f4a5-b207-4a58-a52d-7b81c4fc3e28 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:54.457598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1de8-dada-4d80-a336-27fafb3911c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:54.458193 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1de8-dada-4d80-a336-27fafb3911c1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:54.458464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1de8-dada-4d80-a336-27fafb3911c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:54.458727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db1de8-dada-4d80-a336-27fafb3911c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:54.459360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db1de8-dada-4d80-a336-27fafb3911c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:54.459654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db1de8-dada-4d80-a336-27fafb3911c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:54.461000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db1de8-dada-4d80-a336-27fafb3911c1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:54.472080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 626/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:54.477914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5b0c-d54e-4fcb-a36d-95229afdc4db None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:54.576207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5b0c-d54e-4fcb-a36d-95229afdc4db None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:54.596235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:54.610146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f676-83c1-4b76-86cf-3b165bcfe753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:54.610801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f676-83c1-4b76-86cf-3b165bcfe753 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:54.611073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f676-83c1-4b76-86cf-3b165bcfe753 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:54.611339 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f676-83c1-4b76-86cf-3b165bcfe753 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:54.624183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0f676-83c1-4b76-86cf-3b165bcfe753 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:54.624183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0f676-83c1-4b76-86cf-3b165bcfe753 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2bd0f676-83c1-4b76-86cf-3b165bcfe753 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:47:54.631957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:54.633296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:54.634574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:54.637606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 641/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:54.638861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1de8-dada-4d80-a336-27fafb3911c1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:54.738204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db1de8-dada-4d80-a336-27fafb3911c1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:54.774817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45d85b-cd63-4a39-a027-bccdfc6e16e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:54.775427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45d85b-cd63-4a39-a027-bccdfc6e16e5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:54.775702 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45d85b-cd63-4a39-a027-bccdfc6e16e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:54.775969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45d85b-cd63-4a39-a027-bccdfc6e16e5 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:54.776699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45d85b-cd63-4a39-a027-bccdfc6e16e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:54.776997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45d85b-cd63-4a39-a027-bccdfc6e16e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:54.778436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45d85b-cd63-4a39-a027-bccdfc6e16e5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:54.788250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:54.796107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 627/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 07:47:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:54.802332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f676-83c1-4b76-86cf-3b165bcfe753 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:54.899802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f676-83c1-4b76-86cf-3b165bcfe753 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:54.932601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bb24b-1845-4ef4-9c42-53e041942fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:54.933212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bb24b-1845-4ef4-9c42-53e041942fcb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:54.933504 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bb24b-1845-4ef4-9c42-53e041942fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:54.933773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bb24b-1845-4ef4-9c42-53e041942fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:54.944709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bb24b-1845-4ef4-9c42-53e041942fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:54.946160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bb24b-1845-4ef4-9c42-53e041942fcb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d62bb24b-1845-4ef4-9c42-53e041942fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:54.960074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:54.961057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:54.962080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:54.962080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:54.962080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:54.962080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 642/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:54.968330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45d85b-cd63-4a39-a027-bccdfc6e16e5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:55.066070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45d85b-cd63-4a39-a027-bccdfc6e16e5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:55.100207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd06bf-6f44-4801-b85d-3f404fbe0f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:55.100800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd06bf-6f44-4801-b85d-3f404fbe0f03 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:55.101125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd06bf-6f44-4801-b85d-3f404fbe0f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:55.101396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd06bf-6f44-4801-b85d-3f404fbe0f03 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:55.102220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd06bf-6f44-4801-b85d-3f404fbe0f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:55.102517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd06bf-6f44-4801-b85d-3f404fbe0f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:55.103868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd06bf-6f44-4801-b85d-3f404fbe0f03 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:55.117746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 628/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:47:55.123510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bb24b-1845-4ef4-9c42-53e041942fcb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:55.155247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:55.223448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bb24b-1845-4ef4-9c42-53e041942fcb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:55.257976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4e1ea-b204-4c45-baff-e01ec2cf3219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:55.258596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4e1ea-b204-4c45-baff-e01ec2cf3219 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:55.258871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4e1ea-b204-4c45-baff-e01ec2cf3219 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:55.259146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4e1ea-b204-4c45-baff-e01ec2cf3219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:55.266201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4e1ea-b204-4c45-baff-e01ec2cf3219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:55.267639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4e1ea-b204-4c45-baff-e01ec2cf3219 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-54a4e1ea-b204-4c45-baff-e01ec2cf3219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:47:55.278450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:55.281889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:55.283319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:47:55.283319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:47:55.283319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:47:55.283319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:47:55.283319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:47:55.283319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:47:55.283319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:55.283319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:55.283319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 643/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:47:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:55.287108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd06bf-6f44-4801-b85d-3f404fbe0f03 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:55.346986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:55.387504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd06bf-6f44-4801-b85d-3f404fbe0f03 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:55.420864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f989-a4df-449a-b017-e44e975838df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:55.421488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f989-a4df-449a-b017-e44e975838df None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:55.421780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f989-a4df-449a-b017-e44e975838df None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:55.422095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f989-a4df-449a-b017-e44e975838df None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:55.422812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50f989-a4df-449a-b017-e44e975838df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:55.423109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50f989-a4df-449a-b017-e44e975838df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:55.424602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50f989-a4df-449a-b017-e44e975838df None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:55.436464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 629/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:47:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:55.442900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4e1ea-b204-4c45-baff-e01ec2cf3219 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:55.536204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:55.544452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4e1ea-b204-4c45-baff-e01ec2cf3219 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:55.577071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457dc94-c024-424b-af23-e7a043f74f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:55.577747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457dc94-c024-424b-af23-e7a043f74f99 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:55.578023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457dc94-c024-424b-af23-e7a043f74f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:55.578977 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457dc94-c024-424b-af23-e7a043f74f99 None admin] PATH_INFO: `/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/00093949026746f29def86e4a0b48bf0/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:55.581080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457dc94-c024-424b-af23-e7a043f74f99 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a212c6365964553b8566a7edd7b2e5a, user_id=00093949026746f29def86e4a0b48bf0, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:55.582539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457dc94-c024-424b-af23-e7a043f74f99 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:55.668644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 644/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 07:47:55 2022] PUT /identity/v3/projects/5a212c6365964553b8566a7edd7b2e5a/users/00093949026746f29def86e4a0b48bf0/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:47:57.558699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5f58-440c-4da1-a20c-7b59e839f0fd None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:57.559247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5f58-440c-4da1-a20c-7b59e839f0fd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:57.559247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb5f58-440c-4da1-a20c-7b59e839f0fd None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:57.560614 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 630/1274] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:47:57.566393 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636c1a1-d90c-407f-90b1-6fcfffa0bcdd None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:57.566809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636c1a1-d90c-407f-90b1-6fcfffa0bcdd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:57.566919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636c1a1-d90c-407f-90b1-6fcfffa0bcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:57.586675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9636c1a1-d90c-407f-90b1-6fcfffa0bcdd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:47:57.587857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9636c1a1-d90c-407f-90b1-6fcfffa0bcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:47:57.653278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 645/1275] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:47:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:47:57.925139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb5f58-440c-4da1-a20c-7b59e839f0fd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:58.025515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb5f58-440c-4da1-a20c-7b59e839f0fd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:58.044001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:58.061240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969d421-6b64-41bf-bdcf-c109381d1bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:58.061918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969d421-6b64-41bf-bdcf-c109381d1bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:58.062191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969d421-6b64-41bf-bdcf-c109381d1bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:58.062489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969d421-6b64-41bf-bdcf-c109381d1bf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:58.072258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969d421-6b64-41bf-bdcf-c109381d1bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-b969d421-6b64-41bf-bdcf-c109381d1bf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:47:58.077047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:58.081525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:58.082553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 631/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 07:47:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:58.084233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636c1a1-d90c-407f-90b1-6fcfffa0bcdd None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:58.165996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:58.183991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636c1a1-d90c-407f-90b1-6fcfffa0bcdd None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:58.217400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e98d83-c2aa-4b88-8b65-dfb7ab8d388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:58.218446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e98d83-c2aa-4b88-8b65-dfb7ab8d388b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:58.218446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e98d83-c2aa-4b88-8b65-dfb7ab8d388b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:58.219426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e98d83-c2aa-4b88-8b65-dfb7ab8d388b None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:58.220064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e98d83-c2aa-4b88-8b65-dfb7ab8d388b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:58.220426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e98d83-c2aa-4b88-8b65-dfb7ab8d388b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:58.221818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e98d83-c2aa-4b88-8b65-dfb7ab8d388b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:58.229974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 646/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 07:47:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:58.236306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969d421-6b64-41bf-bdcf-c109381d1bf9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:58.338165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969d421-6b64-41bf-bdcf-c109381d1bf9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:58.371652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4b53-6823-4090-b32f-9afe8be208ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:58.372275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4b53-6823-4090-b32f-9afe8be208ce None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:58.372551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4b53-6823-4090-b32f-9afe8be208ce None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:58.372819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4b53-6823-4090-b32f-9afe8be208ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:58.383456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb4b53-6823-4090-b32f-9afe8be208ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:58.384903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb4b53-6823-4090-b32f-9afe8be208ce None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6cfb4b53-6823-4090-b32f-9afe8be208ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:58.399344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:58.400483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:58.401746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:58.401746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:58.401746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:58.401746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 632/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:58.407502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e98d83-c2aa-4b88-8b65-dfb7ab8d388b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:58.507063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e98d83-c2aa-4b88-8b65-dfb7ab8d388b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:58.543850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209118-8f39-444e-a030-f705574649e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:58.544444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209118-8f39-444e-a030-f705574649e4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:58.544714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209118-8f39-444e-a030-f705574649e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:58.544979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50209118-8f39-444e-a030-f705574649e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:58.545637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209118-8f39-444e-a030-f705574649e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:58.545932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209118-8f39-444e-a030-f705574649e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:58.547566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50209118-8f39-444e-a030-f705574649e4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:58.558977 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 647/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:58.564693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4b53-6823-4090-b32f-9afe8be208ce None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:58.595881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:58.663461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4b53-6823-4090-b32f-9afe8be208ce None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:58.695640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ba4e8-beed-40ac-a541-ff7767c21b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:58.696243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ba4e8-beed-40ac-a541-ff7767c21b1a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:58.696512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ba4e8-beed-40ac-a541-ff7767c21b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:58.696773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ba4e8-beed-40ac-a541-ff7767c21b1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:58.704049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ba4e8-beed-40ac-a541-ff7767c21b1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:58.705456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ba4e8-beed-40ac-a541-ff7767c21b1a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-450ba4e8-beed-40ac-a541-ff7767c21b1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:47:58.718147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:58.721408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:47:58.722662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 633/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:58.725738 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209118-8f39-444e-a030-f705574649e4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:58.729538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:58.822918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50209118-8f39-444e-a030-f705574649e4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:58.856806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02623b8f-b90d-4660-a151-3b6efaf64a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:58.857404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02623b8f-b90d-4660-a151-3b6efaf64a09 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:58.857710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02623b8f-b90d-4660-a151-3b6efaf64a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:58.857980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02623b8f-b90d-4660-a151-3b6efaf64a09 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:58.858704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02623b8f-b90d-4660-a151-3b6efaf64a09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:58.859011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02623b8f-b90d-4660-a151-3b6efaf64a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:58.860566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02623b8f-b90d-4660-a151-3b6efaf64a09 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:58.878122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 648/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 07:47:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:58.883889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ba4e8-beed-40ac-a541-ff7767c21b1a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:58.974895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:58.984250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ba4e8-beed-40ac-a541-ff7767c21b1a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:59.019002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592212d0-ce15-4e76-9812-68ff16098424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:59.019588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592212d0-ce15-4e76-9812-68ff16098424 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:59.019864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592212d0-ce15-4e76-9812-68ff16098424 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:59.020132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592212d0-ce15-4e76-9812-68ff16098424 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:59.086023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592212d0-ce15-4e76-9812-68ff16098424 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:59.087408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592212d0-ce15-4e76-9812-68ff16098424 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:59.174713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:59.184568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 634/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 07:47:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:47:59.191116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02623b8f-b90d-4660-a151-3b6efaf64a09 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:59.253572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:59.291784 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02623b8f-b90d-4660-a151-3b6efaf64a09 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:59.326740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41267e-8c7b-415b-aceb-683be41bc9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:59.327364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41267e-8c7b-415b-aceb-683be41bc9ae None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:59.327635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41267e-8c7b-415b-aceb-683be41bc9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:59.327902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41267e-8c7b-415b-aceb-683be41bc9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:59.339288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41267e-8c7b-415b-aceb-683be41bc9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:59.340654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41267e-8c7b-415b-aceb-683be41bc9ae None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2e41267e-8c7b-415b-aceb-683be41bc9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:47:59.354414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:59.355541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:47:59.356590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:47:59.356590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:47:59.356590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:59.356590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 649/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:59.362006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592212d0-ce15-4e76-9812-68ff16098424 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:59.459602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592212d0-ce15-4e76-9812-68ff16098424 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:59.494270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89bf4f-26ff-4510-95ed-a0c33665df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:59.494925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89bf4f-26ff-4510-95ed-a0c33665df1b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:59.495207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89bf4f-26ff-4510-95ed-a0c33665df1b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:59.495475 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89bf4f-26ff-4510-95ed-a0c33665df1b None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:59.496112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89bf4f-26ff-4510-95ed-a0c33665df1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:59.496412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89bf4f-26ff-4510-95ed-a0c33665df1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:59.497812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89bf4f-26ff-4510-95ed-a0c33665df1b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:59.508938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 635/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 07:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:47:59.514680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41267e-8c7b-415b-aceb-683be41bc9ae None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:59.620612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41267e-8c7b-415b-aceb-683be41bc9ae None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:59.634416 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:59.654187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bdec6-24f9-4f1e-a72c-02a38dbde3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:59.655051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bdec6-24f9-4f1e-a72c-02a38dbde3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:59.655321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bdec6-24f9-4f1e-a72c-02a38dbde3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:59.655590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bdec6-24f9-4f1e-a72c-02a38dbde3b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:59.662661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bdec6-24f9-4f1e-a72c-02a38dbde3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:59.669498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bdec6-24f9-4f1e-a72c-02a38dbde3b4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-dd1bdec6-24f9-4f1e-a72c-02a38dbde3b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:47:59.675613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:47:59.676701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:47:59.677844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:47:59.677844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:47:59.677844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:47:59.677844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:47:59.677844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:47:59.677844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:47:59.677844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:47:59.677844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Aug 24 07:47:59.677844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 650/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 07:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:47:59.682699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89bf4f-26ff-4510-95ed-a0c33665df1b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:59.731688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:59.779862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89bf4f-26ff-4510-95ed-a0c33665df1b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:59.815063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcce80-b3b1-45ba-b8f9-5536d9fe939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:59.815667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcce80-b3b1-45ba-b8f9-5536d9fe939f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:59.815946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcce80-b3b1-45ba-b8f9-5536d9fe939f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:59.816216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcce80-b3b1-45ba-b8f9-5536d9fe939f None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:59.816900 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcce80-b3b1-45ba-b8f9-5536d9fe939f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:59.817223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcce80-b3b1-45ba-b8f9-5536d9fe939f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:59.818675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcce80-b3b1-45ba-b8f9-5536d9fe939f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:59.831021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 636/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 07:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:47:59.837333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bdec6-24f9-4f1e-a72c-02a38dbde3b4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:47:59.937508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bdec6-24f9-4f1e-a72c-02a38dbde3b4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:47:59.971648 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd3eaf-8620-497e-8dbb-ba01a8e19f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:47:59.972281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3eaf-8620-497e-8dbb-ba01a8e19f84 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:47:59.972610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3eaf-8620-497e-8dbb-ba01a8e19f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:47:59.972879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3eaf-8620-497e-8dbb-ba01a8e19f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:47:59.973639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd3eaf-8620-497e-8dbb-ba01a8e19f84 None admin] RBAC: Adding query filter params (role.id=7d5fa916535a4fd5a8e3d51efb289f6a, scope.project.id=5a212c6365964553b8566a7edd7b2e5a, user.id=00093949026746f29def86e4a0b48bf0) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:47:59.973946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd3eaf-8620-497e-8dbb-ba01a8e19f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:47:59.977281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd3eaf-8620-497e-8dbb-ba01a8e19f84 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:47:59.981206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 651/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 07:47:59 2022] GET /identity/v3/role_assignments?user.id=00093949026746f29def86e4a0b48bf0&scope.project.id=5a212c6365964553b8566a7edd7b2e5a&role.id=7d5fa916535a4fd5a8e3d51efb289f6a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:01.913875 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0577-fb20-4cbc-ab1b-0a140ba9dca1 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:01.914417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0577-fb20-4cbc-ab1b-0a140ba9dca1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:01.914417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0577-fb20-4cbc-ab1b-0a140ba9dca1 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:01.915807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 637/1288] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:01.921180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098666b5-fce6-4edb-ae73-c246d698b9fd None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:01.921646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098666b5-fce6-4edb-ae73-c246d698b9fd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:01.921839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098666b5-fce6-4edb-ae73-c246d698b9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:01.941282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-098666b5-fce6-4edb-ae73-c246d698b9fd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:01.942519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-098666b5-fce6-4edb-ae73-c246d698b9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:01.971932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:02.008516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 652/1289] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:02.282391 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0577-fb20-4cbc-ab1b-0a140ba9dca1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:02.384955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0577-fb20-4cbc-ab1b-0a140ba9dca1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:02.395872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:02.418992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f40ac3-68d0-4ffc-a2be-93635b478460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:02.419611 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f40ac3-68d0-4ffc-a2be-93635b478460 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:02.419881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f40ac3-68d0-4ffc-a2be-93635b478460 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:02.420183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f40ac3-68d0-4ffc-a2be-93635b478460 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:02.420712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f40ac3-68d0-4ffc-a2be-93635b478460 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:02.422895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f40ac3-68d0-4ffc-a2be-93635b478460 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-81f40ac3-68d0-4ffc-a2be-93635b478460 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:02.431653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:02.432830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:48:02.433777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 638/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:48:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:02.439934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098666b5-fce6-4edb-ae73-c246d698b9fd None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:02.538275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098666b5-fce6-4edb-ae73-c246d698b9fd None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:02.572178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d2a57-b364-4ab6-baec-80c69718ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:02.572778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2a57-b364-4ab6-baec-80c69718ade0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:02.573055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2a57-b364-4ab6-baec-80c69718ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:02.573324 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2a57-b364-4ab6-baec-80c69718ade0 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:02.573980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d2a57-b364-4ab6-baec-80c69718ade0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:02.574280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d2a57-b364-4ab6-baec-80c69718ade0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:02.575640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d2a57-b364-4ab6-baec-80c69718ade0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:02.580464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 653/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Wed Aug 24 07:48:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:02.586297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f40ac3-68d0-4ffc-a2be-93635b478460 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:02.685203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f40ac3-68d0-4ffc-a2be-93635b478460 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:02.717862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413d4e5-b1cb-40e6-a0a3-8891ece14335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:02.719000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413d4e5-b1cb-40e6-a0a3-8891ece14335 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:02.719279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413d4e5-b1cb-40e6-a0a3-8891ece14335 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:02.719636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413d4e5-b1cb-40e6-a0a3-8891ece14335 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:02.720266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413d4e5-b1cb-40e6-a0a3-8891ece14335 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:02.720585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413d4e5-b1cb-40e6-a0a3-8891ece14335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:02.721977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413d4e5-b1cb-40e6-a0a3-8891ece14335 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:02.726518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 639/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Wed Aug 24 07:48:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:04.620280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44334db-4156-415c-9e01-0f7497d85c9c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:04.620815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44334db-4156-415c-9e01-0f7497d85c9c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:04.620815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44334db-4156-415c-9e01-0f7497d85c9c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:04.622144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 654/1293] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:04.627337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8d7e-14de-4113-9c9d-4dc824368d12 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:04.627716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8d7e-14de-4113-9c9d-4dc824368d12 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:04.627870 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8d7e-14de-4113-9c9d-4dc824368d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:04.646156 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-32dc8d7e-14de-4113-9c9d-4dc824368d12 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:04.647327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-32dc8d7e-14de-4113-9c9d-4dc824368d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:04.676995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:04.714020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 640/1294] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:04.979700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44334db-4156-415c-9e01-0f7497d85c9c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:05.010131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:05.079314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44334db-4156-415c-9e01-0f7497d85c9c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:05.112048 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98f4c3-f0d8-4dd1-9f89-fcf2fbd9a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:05.112644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98f4c3-f0d8-4dd1-9f89-fcf2fbd9a3cf None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:05.112945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98f4c3-f0d8-4dd1-9f89-fcf2fbd9a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:05.113196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98f4c3-f0d8-4dd1-9f89-fcf2fbd9a3cf None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:05.113856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98f4c3-f0d8-4dd1-9f89-fcf2fbd9a3cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:05.115214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98f4c3-f0d8-4dd1-9f89-fcf2fbd9a3cf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:05.200615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 655/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 07:48:04 2022] POST /identity/v3/services => generated 246 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:48:07.118445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e49d2-ad0d-458c-8ca2-94c1674b7cb4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:07.118978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e49d2-ad0d-458c-8ca2-94c1674b7cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:07.118978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e49d2-ad0d-458c-8ca2-94c1674b7cb4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:07.120346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 641/1296] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:07.125986 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993e99-8707-4c28-ac7c-41c12b292eb8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:07.126428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993e99-8707-4c28-ac7c-41c12b292eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:07.126539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993e99-8707-4c28-ac7c-41c12b292eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:07.144971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-19993e99-8707-4c28-ac7c-41c12b292eb8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:07.146252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-19993e99-8707-4c28-ac7c-41c12b292eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:07.218811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 656/1297] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:48:07.485548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e49d2-ad0d-458c-8ca2-94c1674b7cb4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:07.585856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e49d2-ad0d-458c-8ca2-94c1674b7cb4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:07.620159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76d38f-40ad-4bea-9fcd-9523e6f121e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:07.620791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76d38f-40ad-4bea-9fcd-9523e6f121e1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:07.621072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76d38f-40ad-4bea-9fcd-9523e6f121e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:07.621348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76d38f-40ad-4bea-9fcd-9523e6f121e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:07.621977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76d38f-40ad-4bea-9fcd-9523e6f121e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:07.623343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76d38f-40ad-4bea-9fcd-9523e6f121e1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0d76d38f-40ad-4bea-9fcd-9523e6f121e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:07.632028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:07.633246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:48:07.634162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 642/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:48:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:07.639219 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19993e99-8707-4c28-ac7c-41c12b292eb8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:07.658893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:07.737645 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19993e99-8707-4c28-ac7c-41c12b292eb8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:07.770863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a1fe-c2af-4fcb-b7b5-cd176844e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:07.771459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a1fe-c2af-4fcb-b7b5-cd176844e90e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:07.771730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a1fe-c2af-4fcb-b7b5-cd176844e90e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:07.771995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a1fe-c2af-4fcb-b7b5-cd176844e90e None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:07.772613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a1fe-c2af-4fcb-b7b5-cd176844e90e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:07.772908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a1fe-c2af-4fcb-b7b5-cd176844e90e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:07.774280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a1fe-c2af-4fcb-b7b5-cd176844e90e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:07.779196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 657/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Wed Aug 24 07:48:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:07.786155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76d38f-40ad-4bea-9fcd-9523e6f121e1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:07.817656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:07.884727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76d38f-40ad-4bea-9fcd-9523e6f121e1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:07.917631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b70d0-67d0-4983-a20c-5a41415e5b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:07.918218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b70d0-67d0-4983-a20c-5a41415e5b76 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:07.918488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b70d0-67d0-4983-a20c-5a41415e5b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:07.918752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b70d0-67d0-4983-a20c-5a41415e5b76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:07.919438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b70d0-67d0-4983-a20c-5a41415e5b76 None admin] RBAC: Adding query filter params (interface=public, service_id=fdf3caad75b34d619426d9a33664a6b5, region_id=RegionOne) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:07.919741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b70d0-67d0-4983-a20c-5a41415e5b76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:07.921166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b70d0-67d0-4983-a20c-5a41415e5b76 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:07.926670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 643/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 07:48:07 2022] GET /identity/v3/endpoints?service_id=fdf3caad75b34d619426d9a33664a6b5&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:07.932389 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a1fe-c2af-4fcb-b7b5-cd176844e90e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:08.012778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:08.030489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a1fe-c2af-4fcb-b7b5-cd176844e90e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:08.063862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609eb544-50a7-4334-b1d0-729e6338ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:08.064460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb544-50a7-4334-b1d0-729e6338ec65 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:08.064731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb544-50a7-4334-b1d0-729e6338ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:08.064995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609eb544-50a7-4334-b1d0-729e6338ec65 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:08.065609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eb544-50a7-4334-b1d0-729e6338ec65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:08.066952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609eb544-50a7-4334-b1d0-729e6338ec65 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:08.073763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 658/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 07:48:07 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:48:09.991305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccfa8a-409f-4166-bf4d-51606cab359a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:09.991862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccfa8a-409f-4166-bf4d-51606cab359a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:09.991862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccfa8a-409f-4166-bf4d-51606cab359a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:09.993159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 644/1302] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:48:09.998517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6365a6-76a0-4044-91ab-67d3240d8c53 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:09.998935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6365a6-76a0-4044-91ab-67d3240d8c53 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:09.999081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6365a6-76a0-4044-91ab-67d3240d8c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:10.018775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5b6365a6-76a0-4044-91ab-67d3240d8c53 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:48:10.019946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5b6365a6-76a0-4044-91ab-67d3240d8c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:48:10.087687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 659/1303] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:48:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:10.360555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccfa8a-409f-4166-bf4d-51606cab359a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:10.453784 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:10.460424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccfa8a-409f-4166-bf4d-51606cab359a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:10.493922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fa1b0-b0e1-4e5a-a006-a6ab8cc3f6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:10.494542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fa1b0-b0e1-4e5a-a006-a6ab8cc3f6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:10.494817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fa1b0-b0e1-4e5a-a006-a6ab8cc3f6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:10.495150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fa1b0-b0e1-4e5a-a006-a6ab8cc3f6b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:10.495727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fa1b0-b0e1-4e5a-a006-a6ab8cc3f6b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:10.497082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fa1b0-b0e1-4e5a-a006-a6ab8cc3f6b5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-770fa1b0-b0e1-4e5a-a006-a6ab8cc3f6b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:48:10.505823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:48:10.507418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Aug 24 07:48:10.508371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 645/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 07:48:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:48:10.513031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6365a6-76a0-4044-91ab-67d3240d8c53 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:10.588855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:10.611507 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6365a6-76a0-4044-91ab-67d3240d8c53 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:10.644749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38158942-444f-4d5c-9165-d42907ec5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:10.645614 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38158942-444f-4d5c-9165-d42907ec5225 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:10.645910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38158942-444f-4d5c-9165-d42907ec5225 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:10.646365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38158942-444f-4d5c-9165-d42907ec5225 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:10.647399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38158942-444f-4d5c-9165-d42907ec5225 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:48:10.647707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38158942-444f-4d5c-9165-d42907ec5225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:10.649071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38158942-444f-4d5c-9165-d42907ec5225 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:10.654490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 660/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Wed Aug 24 07:48:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:48:10.661231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fa1b0-b0e1-4e5a-a006-a6ab8cc3f6b5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:48:10.758550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fa1b0-b0e1-4e5a-a006-a6ab8cc3f6b5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:48:10.791469 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7095e17-50d8-453d-a7f5-8700f9f56687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:48:10.792052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095e17-50d8-453d-a7f5-8700f9f56687 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:48:10.792326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095e17-50d8-453d-a7f5-8700f9f56687 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:48:10.792591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095e17-50d8-453d-a7f5-8700f9f56687 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:48:10.793299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7095e17-50d8-453d-a7f5-8700f9f56687 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:48:10.794658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7095e17-50d8-453d-a7f5-8700f9f56687 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:48:10.914826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 646/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:48:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:48:20.651251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=30 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:20.910291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:32.218474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ed73-ddd8-495f-aef0-17ac327a4f4e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:32.219662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ed73-ddd8-495f-aef0-17ac327a4f4e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:32.220233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905ed73-ddd8-495f-aef0-17ac327a4f4e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:32.227886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78539-da5f-4d7c-84c5-5837e811129d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:32.228281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78539-da5f-4d7c-84c5-5837e811129d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:32.228480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78539-da5f-4d7c-84c5-5837e811129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:32.233212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 661/1307] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:54:32 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:32.327567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1dd78539-da5f-4d7c-84c5-5837e811129d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:32.328798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1dd78539-da5f-4d7c-84c5-5837e811129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:32.465538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 647/1308] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:54:32.758522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dae9b-ea56-4a53-b935-d068bcbfe1a4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:32.758943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dae9b-ea56-4a53-b935-d068bcbfe1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:32.759304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009dae9b-ea56-4a53-b935-d068bcbfe1a4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:32.760906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 662/1309] 10.222.0.58 () {54 vars in 965 bytes} [Wed Aug 24 07:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:32.766989 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d6dcc-b145-420d-bfed-59fd592e5bf5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:32.767280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d6dcc-b145-420d-bfed-59fd592e5bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:32.767556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d6dcc-b145-420d-bfed-59fd592e5bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:32.846768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9c5d6dcc-b145-420d-bfed-59fd592e5bf5 None None] MFA Rules not processed for user `321d07f93b7540128dc5415d8b3252c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:32.847990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9c5d6dcc-b145-420d-bfed-59fd592e5bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:32.870518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:32.936121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 648/1310] 10.222.0.58 () {58 vars in 1062 bytes} [Wed Aug 24 07:54:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:32.945233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dae9b-ea56-4a53-b935-d068bcbfe1a4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:32.948084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-009dae9b-ea56-4a53-b935-d068bcbfe1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:33.068538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009dae9b-ea56-4a53-b935-d068bcbfe1a4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:33.148747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84f247-2ad0-4a2b-a5f7-344858f00b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:33.149990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f247-2ad0-4a2b-a5f7-344858f00b2b service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:33.150336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f247-2ad0-4a2b-a5f7-344858f00b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:33.150717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f247-2ad0-4a2b-a5f7-344858f00b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:33.152429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ec84f247-2ad0-4a2b-a5f7-344858f00b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:33.210299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:33.267550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84f247-2ad0-4a2b-a5f7-344858f00b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:33.269326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84f247-2ad0-4a2b-a5f7-344858f00b2b service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:33.289458 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 663/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:35.508044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa65d9-8954-4c1d-af95-9b0404b474ab None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:35.508583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa65d9-8954-4c1d-af95-9b0404b474ab None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:35.508583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa65d9-8954-4c1d-af95-9b0404b474ab None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:35.511143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 649/1312] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:35.516632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050476a-21d5-4403-ab41-7aeb21ce0d74 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:35.517173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050476a-21d5-4403-ab41-7aeb21ce0d74 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:35.517173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050476a-21d5-4403-ab41-7aeb21ce0d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:35.596469 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1050476a-21d5-4403-ab41-7aeb21ce0d74 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:35.597909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1050476a-21d5-4403-ab41-7aeb21ce0d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:35.704453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 664/1313] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:36.003114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a20ba-d911-4ab5-a3ad-c95e8f79a4e8 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:36.003427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a20ba-d911-4ab5-a3ad-c95e8f79a4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:36.003704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a20ba-d911-4ab5-a3ad-c95e8f79a4e8 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:36.005085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 650/1314] 10.222.0.58 () {54 vars in 965 bytes} [Wed Aug 24 07:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:36.011368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b7107-c391-43b0-86ca-0b113ce15a38 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:36.011655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b7107-c391-43b0-86ca-0b113ce15a38 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:36.011927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b7107-c391-43b0-86ca-0b113ce15a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:36.023802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:36.090625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-584b7107-c391-43b0-86ca-0b113ce15a38 None None] MFA Rules not processed for user `321d07f93b7540128dc5415d8b3252c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:36.091824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-584b7107-c391-43b0-86ca-0b113ce15a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:36.168328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 665/1315] 10.222.0.58 () {58 vars in 1062 bytes} [Wed Aug 24 07:54:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:36.177057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a20ba-d911-4ab5-a3ad-c95e8f79a4e8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:36.178660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4d4a20ba-d911-4ab5-a3ad-c95e8f79a4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:36.289248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a20ba-d911-4ab5-a3ad-c95e8f79a4e8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:36.365566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:36.368130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4422b7-d655-4219-8c8f-e012f8ae9999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:36.368731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4422b7-d655-4219-8c8f-e012f8ae9999 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:36.369004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4422b7-d655-4219-8c8f-e012f8ae9999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:36.369269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4422b7-d655-4219-8c8f-e012f8ae9999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:36.370890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2a4422b7-d655-4219-8c8f-e012f8ae9999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:36.482761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4422b7-d655-4219-8c8f-e012f8ae9999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:36.484240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4422b7-d655-4219-8c8f-e012f8ae9999 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:36.502854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 651/1316] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:39.146252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aac96-c910-4440-8dcc-26b6d9718203 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.146789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aac96-c910-4440-8dcc-26b6d9718203 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.146789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aac96-c910-4440-8dcc-26b6d9718203 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.148121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 666/1317] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:39.153387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680fb20-919c-457b-80e5-dca24095c5c6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.153824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680fb20-919c-457b-80e5-dca24095c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.153959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680fb20-919c-457b-80e5-dca24095c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.218491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e680fb20-919c-457b-80e5-dca24095c5c6 None None] MFA Rules not processed for user `7d7ee37393394dd29269a36ed2bfd07c`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:39.219683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e680fb20-919c-457b-80e5-dca24095c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:39.271907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:39.315566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 652/1318] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:39.601753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aac96-c910-4440-8dcc-26b6d9718203 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:39.603835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-261aac96-c910-4440-8dcc-26b6d9718203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:39.705087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aac96-c910-4440-8dcc-26b6d9718203 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:39.707899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:39.778908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b5d48-f3d2-4ee5-8d68-dc9322313d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:39.779509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5d48-f3d2-4ee5-8d68-dc9322313d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:39.779785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5d48-f3d2-4ee5-8d68-dc9322313d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:39.780054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b5d48-f3d2-4ee5-8d68-dc9322313d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:39.781687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1c6b5d48-f3d2-4ee5-8d68-dc9322313d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:39.886995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5d48-f3d2-4ee5-8d68-dc9322313d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:39.888353 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b5d48-f3d2-4ee5-8d68-dc9322313d90 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:39.907085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 667/1319] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:42.593633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ceb1b5-54db-46fa-9f49-10df29750dc9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.594158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ceb1b5-54db-46fa-9f49-10df29750dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.594158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ceb1b5-54db-46fa-9f49-10df29750dc9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.595516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 653/1320] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:42.600558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9cd28-5f66-4c50-8e89-01ff4d3aa05c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:42.600964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9cd28-5f66-4c50-8e89-01ff4d3aa05c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:42.601131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9cd28-5f66-4c50-8e89-01ff4d3aa05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:42.641907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:42.667668 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-26b9cd28-5f66-4c50-8e89-01ff4d3aa05c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:42.668880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26b9cd28-5f66-4c50-8e89-01ff4d3aa05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:42.772842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 668/1321] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:43.057729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ceb1b5-54db-46fa-9f49-10df29750dc9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:43.059259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-18ceb1b5-54db-46fa-9f49-10df29750dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:43.160528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ceb1b5-54db-46fa-9f49-10df29750dc9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:43.232235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f59c25-a17b-4c05-9045-5fbed1cf585f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:43.232827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f59c25-a17b-4c05-9045-5fbed1cf585f service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:43.233104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f59c25-a17b-4c05-9045-5fbed1cf585f service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:43.233375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f59c25-a17b-4c05-9045-5fbed1cf585f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:43.234994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-45f59c25-a17b-4c05-9045-5fbed1cf585f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:43.242260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:43.343881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f59c25-a17b-4c05-9045-5fbed1cf585f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:43.345243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f59c25-a17b-4c05-9045-5fbed1cf585f service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:43.363658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 654/1322] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:46.306269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f071fb4-3bff-49fe-93b8-63b311090a8e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:46.306841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f071fb4-3bff-49fe-93b8-63b311090a8e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:46.306841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f071fb4-3bff-49fe-93b8-63b311090a8e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:46.308147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 669/1323] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:46.313431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9942af-f565-41fd-b4a4-ff9ec0c356d5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:46.313867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9942af-f565-41fd-b4a4-ff9ec0c356d5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:46.314089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9942af-f565-41fd-b4a4-ff9ec0c356d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:46.385708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ac9942af-f565-41fd-b4a4-ff9ec0c356d5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:46.386957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ac9942af-f565-41fd-b4a4-ff9ec0c356d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:46.445154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:46.486155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 655/1324] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:46.781146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f071fb4-3bff-49fe-93b8-63b311090a8e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:46.782804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8f071fb4-3bff-49fe-93b8-63b311090a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:46.888017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f071fb4-3bff-49fe-93b8-63b311090a8e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:46.900902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:46.962499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815a265-1f76-4eb4-a2a6-bae0f182ee23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:46.963107 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815a265-1f76-4eb4-a2a6-bae0f182ee23 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:46.963382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815a265-1f76-4eb4-a2a6-bae0f182ee23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:46.963649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815a265-1f76-4eb4-a2a6-bae0f182ee23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:46.965256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0815a265-1f76-4eb4-a2a6-bae0f182ee23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:47.072884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815a265-1f76-4eb4-a2a6-bae0f182ee23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:47.074305 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815a265-1f76-4eb4-a2a6-bae0f182ee23 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:47.092787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 670/1325] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:49.083254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce226f23-2c00-430a-ac5d-333986880aa9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:49.083866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce226f23-2c00-430a-ac5d-333986880aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:49.083866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce226f23-2c00-430a-ac5d-333986880aa9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:49.085268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 656/1326] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:49.091230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c84a5-fa3d-40c8-a552-56258e136bd5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:49.091649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c84a5-fa3d-40c8-a552-56258e136bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:49.091906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c84a5-fa3d-40c8-a552-56258e136bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:49.140346 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:49.161359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-792c84a5-fa3d-40c8-a552-56258e136bd5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:49.161359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-792c84a5-fa3d-40c8-a552-56258e136bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:49.255847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 671/1327] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:49.544883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce226f23-2c00-430a-ac5d-333986880aa9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:49.546461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ce226f23-2c00-430a-ac5d-333986880aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:49.655531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce226f23-2c00-430a-ac5d-333986880aa9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:49.731492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaf9d8-38ee-42c5-a684-61f27820d54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:49.732092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaf9d8-38ee-42c5-a684-61f27820d54f service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:49.732476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaf9d8-38ee-42c5-a684-61f27820d54f service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:49.732749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaf9d8-38ee-42c5-a684-61f27820d54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:49.734362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9adaf9d8-38ee-42c5-a684-61f27820d54f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:49.759007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:49.855915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaf9d8-38ee-42c5-a684-61f27820d54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:49.857572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaf9d8-38ee-42c5-a684-61f27820d54f service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:49.876811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 657/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:51.855760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32ee6f-fcd5-4bfe-9993-83eb4533d804 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:51.856313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32ee6f-fcd5-4bfe-9993-83eb4533d804 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:51.856313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32ee6f-fcd5-4bfe-9993-83eb4533d804 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:51.857750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 672/1329] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:51.863385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46d02-00f0-4acc-977b-287950f11a8e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:51.863872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46d02-00f0-4acc-977b-287950f11a8e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:51.863996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46d02-00f0-4acc-977b-287950f11a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:51.933303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-bda46d02-00f0-4acc-977b-287950f11a8e None None] MFA Rules not processed for user `7d7ee37393394dd29269a36ed2bfd07c`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:51.934552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bda46d02-00f0-4acc-977b-287950f11a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:52.011828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:52.044087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 658/1330] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:52.327836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32ee6f-fcd5-4bfe-9993-83eb4533d804 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:52.329704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-dd32ee6f-fcd5-4bfe-9993-83eb4533d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:52.465060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32ee6f-fcd5-4bfe-9993-83eb4533d804 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:52.486996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:52.543495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98446911-5dd5-4005-a7b7-0fcc94a3f564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:52.544098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98446911-5dd5-4005-a7b7-0fcc94a3f564 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:52.544373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98446911-5dd5-4005-a7b7-0fcc94a3f564 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:52.544640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98446911-5dd5-4005-a7b7-0fcc94a3f564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:52.546299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-98446911-5dd5-4005-a7b7-0fcc94a3f564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:52.656184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98446911-5dd5-4005-a7b7-0fcc94a3f564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:52.657556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98446911-5dd5-4005-a7b7-0fcc94a3f564 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:52.675987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 673/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:55.216313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20833bd8-1c60-472b-b832-9ab9f7e6c81b None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.216954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20833bd8-1c60-472b-b832-9ab9f7e6c81b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.216954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20833bd8-1c60-472b-b832-9ab9f7e6c81b None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.218238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 659/1332] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:55.223477 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d0c1-bb0a-45fb-bb04-33dfc8db51e8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.229957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d0c1-bb0a-45fb-bb04-33dfc8db51e8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.229957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d0c1-bb0a-45fb-bb04-33dfc8db51e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.287666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:55.291179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-dfc8d0c1-bb0a-45fb-bb04-33dfc8db51e8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:55.292387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-dfc8d0c1-bb0a-45fb-bb04-33dfc8db51e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:55.389100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 674/1333] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:55.675171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20833bd8-1c60-472b-b832-9ab9f7e6c81b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:55.676708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-20833bd8-1c60-472b-b832-9ab9f7e6c81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:55.782509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20833bd8-1c60-472b-b832-9ab9f7e6c81b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:55.855898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a90c52-6177-4214-8367-9c43d642a432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:55.856501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90c52-6177-4214-8367-9c43d642a432 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:55.856772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90c52-6177-4214-8367-9c43d642a432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:55.857036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90c52-6177-4214-8367-9c43d642a432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:55.858678 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-91a90c52-6177-4214-8367-9c43d642a432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:55.886142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:55.969816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a90c52-6177-4214-8367-9c43d642a432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:55.971173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a90c52-6177-4214-8367-9c43d642a432 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:55.989128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 660/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:54:57.996726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9927-bbf5-4624-86f3-15c73c296ea8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:57.997246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9927-bbf5-4624-86f3-15c73c296ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:57.997246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9927-bbf5-4624-86f3-15c73c296ea8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:57.998580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 675/1335] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:54:58.003682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad27ece-5e37-436b-a975-eba5be1c516f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.004080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad27ece-5e37-436b-a975-eba5be1c516f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.004213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad27ece-5e37-436b-a975-eba5be1c516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:58.069554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7ad27ece-5e37-436b-a975-eba5be1c516f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:58.070744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7ad27ece-5e37-436b-a975-eba5be1c516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.145028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:58.167949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 661/1336] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:54:58.450628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb9927-bbf5-4624-86f3-15c73c296ea8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:58.452214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4ebb9927-bbf5-4624-86f3-15c73c296ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.556708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb9927-bbf5-4624-86f3-15c73c296ea8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:58.584474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:58.629327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72661b46-9b82-4a32-b887-293b8916bafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:58.629899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72661b46-9b82-4a32-b887-293b8916bafa service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:58.630438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72661b46-9b82-4a32-b887-293b8916bafa service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:58.630925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72661b46-9b82-4a32-b887-293b8916bafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:58.632889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-72661b46-9b82-4a32-b887-293b8916bafa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:58.740086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72661b46-9b82-4a32-b887-293b8916bafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:58.741528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72661b46-9b82-4a32-b887-293b8916bafa service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:58.760584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 676/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:01.300752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe55c4-8aff-4c6b-ab7f-579907ce419a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:01.301289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe55c4-8aff-4c6b-ab7f-579907ce419a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:01.301418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe55c4-8aff-4c6b-ab7f-579907ce419a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:01.302705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 662/1338] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:01.308252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e208d5-0f56-4640-8be0-6b58968e4c0e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:01.308701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e208d5-0f56-4640-8be0-6b58968e4c0e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:01.308824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e208d5-0f56-4640-8be0-6b58968e4c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:01.375623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-73e208d5-0f56-4640-8be0-6b58968e4c0e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:01.377093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-73e208d5-0f56-4640-8be0-6b58968e4c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:01.385834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:01.474107 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 677/1339] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:01.759175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe55c4-8aff-4c6b-ab7f-579907ce419a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:01.761341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-37fe55c4-8aff-4c6b-ab7f-579907ce419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:01.862094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe55c4-8aff-4c6b-ab7f-579907ce419a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:01.933180 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc713728-d364-4cc5-8a49-343df4989147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:01.933795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc713728-d364-4cc5-8a49-343df4989147 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:01.934073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc713728-d364-4cc5-8a49-343df4989147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:01.934340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc713728-d364-4cc5-8a49-343df4989147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:01.935897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fc713728-d364-4cc5-8a49-343df4989147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:01.971092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:02.043610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc713728-d364-4cc5-8a49-343df4989147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:02.044978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc713728-d364-4cc5-8a49-343df4989147 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:02.063089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 663/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:06.379932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50fd75-d65a-4b36-a869-231773c6f4ef None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.380302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50fd75-d65a-4b36-a869-231773c6f4ef None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.380560 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50fd75-d65a-4b36-a869-231773c6f4ef None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.381843 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 678/1341] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:06.387833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910f800-ba41-45c0-ab9e-29c98e658bf0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:06.388290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910f800-ba41-45c0-ab9e-29c98e658bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:06.388397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910f800-ba41-45c0-ab9e-29c98e658bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:06.456621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0910f800-ba41-45c0-ab9e-29c98e658bf0 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:06.457861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0910f800-ba41-45c0-ab9e-29c98e658bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:06.544389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:06.555720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 664/1342] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:06.841999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50fd75-d65a-4b36-a869-231773c6f4ef None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:06.843533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ae50fd75-d65a-4b36-a869-231773c6f4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:06.948020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50fd75-d65a-4b36-a869-231773c6f4ef None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:06.987079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:07.024466 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e597f-ae0d-4807-9cdf-a662d88586ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:07.025646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e597f-ae0d-4807-9cdf-a662d88586ff service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:07.025924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e597f-ae0d-4807-9cdf-a662d88586ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:07.026195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e597f-ae0d-4807-9cdf-a662d88586ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:07.027799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-de5e597f-ae0d-4807-9cdf-a662d88586ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:07.139218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e597f-ae0d-4807-9cdf-a662d88586ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:07.140576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e597f-ae0d-4807-9cdf-a662d88586ff service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:07.160393 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 679/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:10.157109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c044c-de67-482b-9a76-a9a0be657bde None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.157674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c044c-de67-482b-9a76-a9a0be657bde None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.157674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c044c-de67-482b-9a76-a9a0be657bde None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.158955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 665/1344] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:10.164109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45e184-39e1-4779-999f-4d336cb81f83 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.164536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45e184-39e1-4779-999f-4d336cb81f83 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.164632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45e184-39e1-4779-999f-4d336cb81f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.230738 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4f45e184-39e1-4779-999f-4d336cb81f83 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:10.231942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4f45e184-39e1-4779-999f-4d336cb81f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:10.250175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:10.330366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 680/1345] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:10.618057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c044c-de67-482b-9a76-a9a0be657bde None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:10.620694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5e8c044c-de67-482b-9a76-a9a0be657bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:10.729415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c044c-de67-482b-9a76-a9a0be657bde None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:10.806239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c2cc3-27b9-4f68-9351-d028d2cca1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:10.806848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c2cc3-27b9-4f68-9351-d028d2cca1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:10.807125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c2cc3-27b9-4f68-9351-d028d2cca1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:10.807395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c2cc3-27b9-4f68-9351-d028d2cca1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:10.809014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1f1c2cc3-27b9-4f68-9351-d028d2cca1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:10.856465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:10.926422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c2cc3-27b9-4f68-9351-d028d2cca1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:10.927889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c2cc3-27b9-4f68-9351-d028d2cca1a3 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:10.946939 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 666/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:15.116663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf0329-6912-4cd6-8468-d3f2bb622678 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:15.117169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf0329-6912-4cd6-8468-d3f2bb622678 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:15.117260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf0329-6912-4cd6-8468-d3f2bb622678 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:15.118686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 681/1347] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:15.124363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9032-f7e7-4e3e-af02-dca9ac440920 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:15.124836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9032-f7e7-4e3e-af02-dca9ac440920 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:15.125034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9032-f7e7-4e3e-af02-dca9ac440920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:15.197573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-550e9032-f7e7-4e3e-af02-dca9ac440920 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:15.198805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-550e9032-f7e7-4e3e-af02-dca9ac440920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:15.301197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:15.303778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 667/1348] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:15.585749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf0329-6912-4cd6-8468-d3f2bb622678 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:15.588020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fbaf0329-6912-4cd6-8468-d3f2bb622678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:15.696036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf0329-6912-4cd6-8468-d3f2bb622678 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:15.745871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:15.773774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce450e-e553-4742-873a-c3387242d1f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:15.774917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce450e-e553-4742-873a-c3387242d1f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:15.775188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce450e-e553-4742-873a-c3387242d1f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:15.775448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce450e-e553-4742-873a-c3387242d1f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:15.777504 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-52ce450e-e553-4742-873a-c3387242d1f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:15.892361 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce450e-e553-4742-873a-c3387242d1f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:15.893829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce450e-e553-4742-873a-c3387242d1f8 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:15.912557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 682/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:20.860139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882cb60-186e-4948-bb2c-d61d678dd240 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.860609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882cb60-186e-4948-bb2c-d61d678dd240 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.860706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882cb60-186e-4948-bb2c-d61d678dd240 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.862052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 668/1350] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 07:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:20.867295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f86e1-ac80-4361-9038-36f9f6ac369c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:20.867742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f86e1-ac80-4361-9038-36f9f6ac369c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:20.870151 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f86e1-ac80-4361-9038-36f9f6ac369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:20.981421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-449f86e1-ac80-4361-9038-36f9f6ac369c None None] MFA Rules not processed for user `00093949026746f29def86e4a0b48bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:20.982937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-449f86e1-ac80-4361-9038-36f9f6ac369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:21.027704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:21.120120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 683/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 07:55:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:25.283642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65b4c-6555-4262-b3d3-6eb2bb2c0b00 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:25.284170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65b4c-6555-4262-b3d3-6eb2bb2c0b00 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:25.284656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65b4c-6555-4262-b3d3-6eb2bb2c0b00 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:25.286112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 669/1352] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 07:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:25.291885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dbc25-009f-42de-bfb1-3458e4307e7f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:25.292325 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dbc25-009f-42de-bfb1-3458e4307e7f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:25.292617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dbc25-009f-42de-bfb1-3458e4307e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:25.377940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-201dbc25-009f-42de-bfb1-3458e4307e7f None None] MFA Rules not processed for user `00093949026746f29def86e4a0b48bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:25.379229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-201dbc25-009f-42de-bfb1-3458e4307e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:25.453902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:25.493189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 684/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 07:55:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:26.985756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656c1be-4591-44e2-8199-3e4d5b0cb6cf None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:26.986350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656c1be-4591-44e2-8199-3e4d5b0cb6cf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:26.986464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656c1be-4591-44e2-8199-3e4d5b0cb6cf None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:26.987784 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 670/1354] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 07:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:26.992894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159a1a8-dc63-48bc-8a5d-559b29ee7982 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:26.993334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159a1a8-dc63-48bc-8a5d-559b29ee7982 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:26.993437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159a1a8-dc63-48bc-8a5d-559b29ee7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:27.070145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-3159a1a8-dc63-48bc-8a5d-559b29ee7982 None None] MFA Rules not processed for user `00093949026746f29def86e4a0b48bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:27.071359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3159a1a8-dc63-48bc-8a5d-559b29ee7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:27.180967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 685/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 07:55:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:30.511421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aa2af-acc9-4ea9-84e3-ba4b638e859b None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.511944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aa2af-acc9-4ea9-84e3-ba4b638e859b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.511944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aa2af-acc9-4ea9-84e3-ba4b638e859b None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.513414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 671/1356] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:30.519417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98574ce-f5a8-4751-94c5-0a4f9ae182a2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:30.519843 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98574ce-f5a8-4751-94c5-0a4f9ae182a2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:30.519968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98574ce-f5a8-4751-94c5-0a4f9ae182a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:30.569934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:30.614059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f98574ce-f5a8-4751-94c5-0a4f9ae182a2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:30.615307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f98574ce-f5a8-4751-94c5-0a4f9ae182a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:30.752672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 686/1357] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:31.058931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9c68a-1ba9-47ed-9116-f59c3a4d6dd6 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.059614 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9c68a-1ba9-47ed-9116-f59c3a4d6dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.060103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9c68a-1ba9-47ed-9116-f59c3a4d6dd6 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.062359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 672/1358] 10.222.0.58 () {54 vars in 962 bytes} [Wed Aug 24 07:55:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:55:31.071683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b405f1-0e03-4a20-b5cb-af952f45e30b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.072959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b405f1-0e03-4a20-b5cb-af952f45e30b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.073449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b405f1-0e03-4a20-b5cb-af952f45e30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.169662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-19b405f1-0e03-4a20-b5cb-af952f45e30b None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:31.170896 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-19b405f1-0e03-4a20-b5cb-af952f45e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:31.223530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:31.308241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 687/1359] 10.222.0.58 () {58 vars in 1059 bytes} [Wed Aug 24 07:55:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:31.316196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9c68a-1ba9-47ed-9116-f59c3a4d6dd6 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:31.318460 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-96e9c68a-1ba9-47ed-9116-f59c3a4d6dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:31.477569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9c68a-1ba9-47ed-9116-f59c3a4d6dd6 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:31.554346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:31.597249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde0493-3dc5-4569-bef5-e3d51b9426bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:31.598033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde0493-3dc5-4569-bef5-e3d51b9426bb service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:31.598406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde0493-3dc5-4569-bef5-e3d51b9426bb service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:31.598795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde0493-3dc5-4569-bef5-e3d51b9426bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:31.600508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5bde0493-3dc5-4569-bef5-e3d51b9426bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:31.693059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde0493-3dc5-4569-bef5-e3d51b9426bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:31.694841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde0493-3dc5-4569-bef5-e3d51b9426bb service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:31.713866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 673/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:33.865189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795cae-a939-47db-8a03-c6ca60dfe913 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.865755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795cae-a939-47db-8a03-c6ca60dfe913 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.865755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f795cae-a939-47db-8a03-c6ca60dfe913 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.867269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 688/1361] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:33.872984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a02273-95a3-4eec-8ff7-3d1f1da1316c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:33.873425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a02273-95a3-4eec-8ff7-3d1f1da1316c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:33.873631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a02273-95a3-4eec-8ff7-3d1f1da1316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:33.943473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b0a02273-95a3-4eec-8ff7-3d1f1da1316c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:33.944685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b0a02273-95a3-4eec-8ff7-3d1f1da1316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:33.986889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:34.057091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 674/1362] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:34.357707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795cae-a939-47db-8a03-c6ca60dfe913 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:34.357707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6f795cae-a939-47db-8a03-c6ca60dfe913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:34.530364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f795cae-a939-47db-8a03-c6ca60dfe913 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:34.542084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:34.656251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd99afc-72d2-4385-82c0-b7995b554d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:34.657450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99afc-72d2-4385-82c0-b7995b554d25 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:34.657859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99afc-72d2-4385-82c0-b7995b554d25 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:34.658169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99afc-72d2-4385-82c0-b7995b554d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:34.659842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3fd99afc-72d2-4385-82c0-b7995b554d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:34.760426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd99afc-72d2-4385-82c0-b7995b554d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:34.762288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd99afc-72d2-4385-82c0-b7995b554d25 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:34.784206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 689/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:37.210904 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1249ee-b35c-4efa-8444-c06899437522 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.211470 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1249ee-b35c-4efa-8444-c06899437522 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.211809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1249ee-b35c-4efa-8444-c06899437522 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.213395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 675/1364] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:37.218777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383cbf-ce61-4cf1-a51d-bae558a89de3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.219168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383cbf-ce61-4cf1-a51d-bae558a89de3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.219352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383cbf-ce61-4cf1-a51d-bae558a89de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.236250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:37.290984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b3383cbf-ce61-4cf1-a51d-bae558a89de3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:37.292188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b3383cbf-ce61-4cf1-a51d-bae558a89de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.413866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 690/1365] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:37.712131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b040ffb-1a84-438b-beaa-37848a6960db None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.712616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b040ffb-1a84-438b-beaa-37848a6960db None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.712985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b040ffb-1a84-438b-beaa-37848a6960db None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.714512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 676/1366] 10.222.0.58 () {54 vars in 962 bytes} [Wed Aug 24 07:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:37.722774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff099f-43c7-406b-9828-c384514d6151 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:37.722774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff099f-43c7-406b-9828-c384514d6151 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:37.722774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff099f-43c7-406b-9828-c384514d6151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:37.806468 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a0ff099f-43c7-406b-9828-c384514d6151 None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:37.807707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a0ff099f-43c7-406b-9828-c384514d6151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:37.846892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:37.942383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 691/1367] 10.222.0.58 () {58 vars in 1059 bytes} [Wed Aug 24 07:55:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:37.951091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b040ffb-1a84-438b-beaa-37848a6960db None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:37.952847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5b040ffb-1a84-438b-beaa-37848a6960db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:38.114897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b040ffb-1a84-438b-beaa-37848a6960db None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:38.135844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:38.242040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff758568-6ef4-4c1a-8aab-6090207033c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:38.243427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff758568-6ef4-4c1a-8aab-6090207033c2 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:38.243861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff758568-6ef4-4c1a-8aab-6090207033c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:38.244273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff758568-6ef4-4c1a-8aab-6090207033c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:38.246033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ff758568-6ef4-4c1a-8aab-6090207033c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:38.355776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff758568-6ef4-4c1a-8aab-6090207033c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:38.357706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff758568-6ef4-4c1a-8aab-6090207033c2 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:38.378548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 677/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:38.797291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4c5d-5d8d-4b11-9b09-1e416e03ed70 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:38.797898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4c5d-5d8d-4b11-9b09-1e416e03ed70 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:38.797898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4c5d-5d8d-4b11-9b09-1e416e03ed70 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:38.803263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 692/1369] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:38.804582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfcf8f-83a2-41a5-9a7c-0ada7354b24c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:38.805490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfcf8f-83a2-41a5-9a7c-0ada7354b24c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:38.805776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfcf8f-83a2-41a5-9a7c-0ada7354b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:38.838241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:38.875492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a1bfcf8f-83a2-41a5-9a7c-0ada7354b24c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:38.876781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a1bfcf8f-83a2-41a5-9a7c-0ada7354b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:38.978743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 678/1370] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:39.562246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b409-0011-47cd-a2aa-69dbb24c2244 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.562246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b409-0011-47cd-a2aa-69dbb24c2244 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.562246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6b409-0011-47cd-a2aa-69dbb24c2244 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.566768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 693/1371] 10.222.0.58 () {54 vars in 964 bytes} [Wed Aug 24 07:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:39.569309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21900e14-d401-406c-8465-47ec4c9ed444 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.569309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21900e14-d401-406c-8465-47ec4c9ed444 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.570837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21900e14-d401-406c-8465-47ec4c9ed444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.653216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-21900e14-d401-406c-8465-47ec4c9ed444 None None] MFA Rules not processed for user `23734a2b701a46c3a25ae547aff98026`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:39.654356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-21900e14-d401-406c-8465-47ec4c9ed444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:39.706133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:39.739450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 679/1372] 10.222.0.58 () {58 vars in 1061 bytes} [Wed Aug 24 07:55:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:39.748161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6b409-0011-47cd-a2aa-69dbb24c2244 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:39.749780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3fa6b409-0011-47cd-a2aa-69dbb24c2244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:39.858561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6b409-0011-47cd-a2aa-69dbb24c2244 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:39.903114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:39.948579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cc525-d52c-4f10-b384-b2aeeafa444e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:39.949306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cc525-d52c-4f10-b384-b2aeeafa444e service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:39.949708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cc525-d52c-4f10-b384-b2aeeafa444e service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:39.950079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cc525-d52c-4f10-b384-b2aeeafa444e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:39.951854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-879cc525-d52c-4f10-b384-b2aeeafa444e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.079176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cc525-d52c-4f10-b384-b2aeeafa444e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:40.081224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cc525-d52c-4f10-b384-b2aeeafa444e service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:40.109883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 694/1373] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:40.547926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11763254-9513-4d2f-8c4a-053c1f007367 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.548154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11763254-9513-4d2f-8c4a-053c1f007367 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.548451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11763254-9513-4d2f-8c4a-053c1f007367 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.549885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 680/1374] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:40.555207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75e7c4-7cdf-49fb-8417-b6e1f8b24d0c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:40.555490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75e7c4-7cdf-49fb-8417-b6e1f8b24d0c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:40.555761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75e7c4-7cdf-49fb-8417-b6e1f8b24d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:40.621486 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-fe75e7c4-7cdf-49fb-8417-b6e1f8b24d0c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:40.622728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fe75e7c4-7cdf-49fb-8417-b6e1f8b24d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:40.643584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:40.720194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 695/1375] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:41.010858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11763254-9513-4d2f-8c4a-053c1f007367 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:41.012385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-11763254-9513-4d2f-8c4a-053c1f007367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:41.161662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11763254-9513-4d2f-8c4a-053c1f007367 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:41.215178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:41.277144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092d4fd-43cc-4d39-937e-c7a5ac024743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:41.277779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092d4fd-43cc-4d39-937e-c7a5ac024743 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:41.278063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092d4fd-43cc-4d39-937e-c7a5ac024743 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:41.278316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092d4fd-43cc-4d39-937e-c7a5ac024743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:41.279895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6092d4fd-43cc-4d39-937e-c7a5ac024743 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:41.373813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092d4fd-43cc-4d39-937e-c7a5ac024743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:41.375429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092d4fd-43cc-4d39-937e-c7a5ac024743 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:41.393223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 681/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:43.525873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452dc9e-1dee-49be-adbe-976e3549bd96 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.526357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452dc9e-1dee-49be-adbe-976e3549bd96 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.526357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452dc9e-1dee-49be-adbe-976e3549bd96 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.527663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 696/1377] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:43.532886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a123-86f6-4140-ad69-e190099f92b5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:43.533306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a123-86f6-4140-ad69-e190099f92b5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:43.533712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a123-86f6-4140-ad69-e190099f92b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:43.606078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c8a6a123-86f6-4140-ad69-e190099f92b5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:43.607261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c8a6a123-86f6-4140-ad69-e190099f92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:43.613916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:43.706873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 682/1378] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:44.034382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452dc9e-1dee-49be-adbe-976e3549bd96 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:44.036242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f452dc9e-1dee-49be-adbe-976e3549bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:44.218926 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452dc9e-1dee-49be-adbe-976e3549bd96 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:44.223314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:44.353221 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee95af6-7d52-4103-a263-495d32cae9ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:44.353868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee95af6-7d52-4103-a263-495d32cae9ad service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:44.354143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee95af6-7d52-4103-a263-495d32cae9ad service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:44.354415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee95af6-7d52-4103-a263-495d32cae9ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:44.356207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0ee95af6-7d52-4103-a263-495d32cae9ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:44.463269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee95af6-7d52-4103-a263-495d32cae9ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:44.464962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee95af6-7d52-4103-a263-495d32cae9ad service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:44.486764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 697/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:46.600984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffa50e-c58e-4a33-8bf5-8093f57f90f9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.601740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffa50e-c58e-4a33-8bf5-8093f57f90f9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.601740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffa50e-c58e-4a33-8bf5-8093f57f90f9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.603151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 683/1380] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:46.608451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175343ac-336d-4a81-85a4-fd9ace783f9c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:46.608948 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175343ac-336d-4a81-85a4-fd9ace783f9c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:46.609087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175343ac-336d-4a81-85a4-fd9ace783f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:46.621006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:46.678736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-175343ac-336d-4a81-85a4-fd9ace783f9c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:46.680204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-175343ac-336d-4a81-85a4-fd9ace783f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:46.791165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 698/1381] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:47.081800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffa50e-c58e-4a33-8bf5-8093f57f90f9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:47.083311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e0ffa50e-c58e-4a33-8bf5-8093f57f90f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:47.226255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:47.237542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffa50e-c58e-4a33-8bf5-8093f57f90f9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:47.370783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f7145-0441-4fbc-b60d-e2f522e0a319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:47.371404 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7145-0441-4fbc-b60d-e2f522e0a319 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:47.371687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7145-0441-4fbc-b60d-e2f522e0a319 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:47.371983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7145-0441-4fbc-b60d-e2f522e0a319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:47.373643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c20f7145-0441-4fbc-b60d-e2f522e0a319 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:47.468620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f7145-0441-4fbc-b60d-e2f522e0a319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:47.470281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f7145-0441-4fbc-b60d-e2f522e0a319 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:47.482289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:47.490806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 684/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:49.598744 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40321a-65aa-4900-85b5-83df5b78971c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:49.599303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40321a-65aa-4900-85b5-83df5b78971c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:49.599500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40321a-65aa-4900-85b5-83df5b78971c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:49.602113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 699/1383] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:55:49.608814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7428496-31ec-4042-b406-fde11485aa4a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:49.609237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7428496-31ec-4042-b406-fde11485aa4a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:49.609354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7428496-31ec-4042-b406-fde11485aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:49.690900 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d7428496-31ec-4042-b406-fde11485aa4a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:49.692452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d7428496-31ec-4042-b406-fde11485aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:49.805417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 685/1384] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:50.187653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40321a-65aa-4900-85b5-83df5b78971c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:50.189671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-aa40321a-65aa-4900-85b5-83df5b78971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:50.277126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:50.340552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40321a-65aa-4900-85b5-83df5b78971c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:50.476873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32da4b4-1f27-4091-b67c-4e1d9b2eb083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:50.477721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da4b4-1f27-4091-b67c-4e1d9b2eb083 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:50.477830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da4b4-1f27-4091-b67c-4e1d9b2eb083 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:50.478048 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da4b4-1f27-4091-b67c-4e1d9b2eb083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:50.479666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c32da4b4-1f27-4091-b67c-4e1d9b2eb083 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:50.533664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:50.578715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32da4b4-1f27-4091-b67c-4e1d9b2eb083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:50.580337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32da4b4-1f27-4091-b67c-4e1d9b2eb083 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:50.599095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 700/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:52.511322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96ef42-242c-44d3-931f-16e86ed3a98e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.511853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96ef42-242c-44d3-931f-16e86ed3a98e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.512066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96ef42-242c-44d3-931f-16e86ed3a98e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.514193 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 686/1386] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:52.519602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd9dd0-aa0c-4bf7-a7a8-e618aed11d63 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:52.520068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd9dd0-aa0c-4bf7-a7a8-e618aed11d63 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:52.520165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd9dd0-aa0c-4bf7-a7a8-e618aed11d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:52.600370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0edd9dd0-aa0c-4bf7-a7a8-e618aed11d63 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:52.601676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0edd9dd0-aa0c-4bf7-a7a8-e618aed11d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:52.708912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 701/1387] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:53.003817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96ef42-242c-44d3-931f-16e86ed3a98e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:53.005844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6a96ef42-242c-44d3-931f-16e86ed3a98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:53.095424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:53.188409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96ef42-242c-44d3-931f-16e86ed3a98e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:53.319050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197d26-8f7c-4528-8019-be3aec425583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:53.320215 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197d26-8f7c-4528-8019-be3aec425583 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:53.320545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197d26-8f7c-4528-8019-be3aec425583 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:53.321008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197d26-8f7c-4528-8019-be3aec425583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:53.322675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-92197d26-8f7c-4528-8019-be3aec425583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:53.362891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:53.419534 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92197d26-8f7c-4528-8019-be3aec425583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:53.421995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92197d26-8f7c-4528-8019-be3aec425583 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:53.446016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 687/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:55.538527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b50065-12a1-481c-9f3e-7078e9453cbd None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:55.539137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b50065-12a1-481c-9f3e-7078e9453cbd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:55.539137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b50065-12a1-481c-9f3e-7078e9453cbd None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:55.540604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 702/1389] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:55.546118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2548e5-74d7-470c-820d-075a9dc2b721 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:55.546579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2548e5-74d7-470c-820d-075a9dc2b721 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:55.546690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2548e5-74d7-470c-820d-075a9dc2b721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:55.614497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ac2548e5-74d7-470c-820d-075a9dc2b721 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:55.615746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ac2548e5-74d7-470c-820d-075a9dc2b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:55.622623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b68aa-c0dc-400d-b0ab-5e82a3164428 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:55.622975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b68aa-c0dc-400d-b0ab-5e82a3164428 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:55.623314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b68aa-c0dc-400d-b0ab-5e82a3164428 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:55.624767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 703/1390] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:55:55.629811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366c5dc-64df-4c76-8609-b953e7fdc999 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:55.630093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366c5dc-64df-4c76-8609-b953e7fdc999 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:55.630362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366c5dc-64df-4c76-8609-b953e7fdc999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:55.672437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:55.703754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0366c5dc-64df-4c76-8609-b953e7fdc999 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:55.704971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0366c5dc-64df-4c76-8609-b953e7fdc999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:55.714627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 688/1391] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:55.803840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 704/1392] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:56.010186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2548e5-74d7-470c-820d-075a9dc2b721 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:56.011380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ac2548e5-74d7-470c-820d-075a9dc2b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:56.026024 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:56.108005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb443b-033e-4a68-8f9a-94b16c6a1bc4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:56.108292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb443b-033e-4a68-8f9a-94b16c6a1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:56.108873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb443b-033e-4a68-8f9a-94b16c6a1bc4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:56.110243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 705/1393] 10.222.0.58 () {54 vars in 967 bytes} [Wed Aug 24 07:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:56.114892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabc2c2-d87c-4901-ab2c-4363e77997a3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:56.115169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabc2c2-d87c-4901-ab2c-4363e77997a3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:56.115436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabc2c2-d87c-4901-ab2c-4363e77997a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:56.129074 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2548e5-74d7-470c-820d-075a9dc2b721 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:56.191991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1aabc2c2-d87c-4901-ab2c-4363e77997a3 None None] MFA Rules not processed for user `79bb81300cff46b7ba1680eedf2762cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:56.193183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1aabc2c2-d87c-4901-ab2c-4363e77997a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:56.243868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:56.246317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3468e3-19ed-47c8-891d-1e3f883bcc51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:56.246923 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3468e3-19ed-47c8-891d-1e3f883bcc51 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:56.247538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3468e3-19ed-47c8-891d-1e3f883bcc51 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:56.247762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3468e3-19ed-47c8-891d-1e3f883bcc51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:56.249371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3c3468e3-19ed-47c8-891d-1e3f883bcc51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:56.258192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:56.273301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 706/1394] 10.222.0.58 () {58 vars in 1064 bytes} [Wed Aug 24 07:55:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:56.282562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabc2c2-d87c-4901-ab2c-4363e77997a3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:56.290377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabc2c2-d87c-4901-ab2c-4363e77997a3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:56.347245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3468e3-19ed-47c8-891d-1e3f883bcc51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:56.349151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3468e3-19ed-47c8-891d-1e3f883bcc51 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:56.368046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057f1a5-d863-452f-9caf-19c0bdafb918 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79bb81300cff46b7ba1680eedf2762cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:56.368653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f1a5-d863-452f-9caf-19c0bdafb918 service glance] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:56.368759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 689/1395] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:55:56.369008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f1a5-d863-452f-9caf-19c0bdafb918 service glance] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:56.369283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f1a5-d863-452f-9caf-19c0bdafb918 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:56.371105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c057f1a5-d863-452f-9caf-19c0bdafb918 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:56.481638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057f1a5-d863-452f-9caf-19c0bdafb918 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:56.483101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057f1a5-d863-452f-9caf-19c0bdafb918 service glance] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:56.497454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:56.502173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 707/1396] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:55:57.461110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbac2be-1df1-42eb-9685-7d1429cda61b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:57.462186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbac2be-1df1-42eb-9685-7d1429cda61b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:57.462186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbac2be-1df1-42eb-9685-7d1429cda61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:57.529933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fcbac2be-1df1-42eb-9685-7d1429cda61b None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:57.531131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fcbac2be-1df1-42eb-9685-7d1429cda61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:57.619109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:57.622533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 690/1397] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 07:55:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:57.667491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c1455-fca2-43d9-b2be-2308fe7cf21a None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:57.668029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c1455-fca2-43d9-b2be-2308fe7cf21a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:57.668029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c1455-fca2-43d9-b2be-2308fe7cf21a None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:57.669406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 708/1398] 10.222.0.58 () {54 vars in 943 bytes} [Wed Aug 24 07:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:57.675584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbaea9-c8ca-4d76-8675-b1b8416e991c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:57.675868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbaea9-c8ca-4d76-8675-b1b8416e991c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:57.676169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbaea9-c8ca-4d76-8675-b1b8416e991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:57.752204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dafbaea9-c8ca-4d76-8675-b1b8416e991c None None] MFA Rules not processed for user `f362b8daae13435a9a468b06c4998c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:57.753303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dafbaea9-c8ca-4d76-8675-b1b8416e991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:57.863626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 691/1399] 10.222.0.58 () {58 vars in 1040 bytes} [Wed Aug 24 07:55:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:55:57.873135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c1455-fca2-43d9-b2be-2308fe7cf21a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:57.874770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5a8c1455-fca2-43d9-b2be-2308fe7cf21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:58.014132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c1455-fca2-43d9-b2be-2308fe7cf21a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:58.108420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:58.129023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f01717-d733-41e4-8e36-44c8c9d9255b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:58.129656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f01717-d733-41e4-8e36-44c8c9d9255b service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:58.129996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f01717-d733-41e4-8e36-44c8c9d9255b service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:58.130261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f01717-d733-41e4-8e36-44c8c9d9255b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:58.132652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a1f01717-d733-41e4-8e36-44c8c9d9255b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:58.224065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f01717-d733-41e4-8e36-44c8c9d9255b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:58.225676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f01717-d733-41e4-8e36-44c8c9d9255b service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:58.233807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 709/1400] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 07:55:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:55:58.741012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ddc29-da5f-4183-8d67-c05685e67cd1 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:58.742231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ddc29-da5f-4183-8d67-c05685e67cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:58.742231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ddc29-da5f-4183-8d67-c05685e67cd1 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:58.743489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 692/1401] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:55:58.749089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac538-1ed7-4dca-8fd8-ea066aacf11a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:58.749530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac538-1ed7-4dca-8fd8-ea066aacf11a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:58.749789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aac538-1ed7-4dca-8fd8-ea066aacf11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:58.826226 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-27aac538-1ed7-4dca-8fd8-ea066aacf11a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:55:58.827749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-27aac538-1ed7-4dca-8fd8-ea066aacf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:58.916612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:58.956167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 710/1402] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:55:59.261642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ddc29-da5f-4183-8d67-c05685e67cd1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:55:59.263194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-689ddc29-da5f-4183-8d67-c05685e67cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:59.355058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:59.486316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ddc29-da5f-4183-8d67-c05685e67cd1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:55:59.637880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35469524-58e4-4064-9dac-ecae7f67095b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:55:59.638496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35469524-58e4-4064-9dac-ecae7f67095b service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:55:59.638774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35469524-58e4-4064-9dac-ecae7f67095b service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:55:59.639172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35469524-58e4-4064-9dac-ecae7f67095b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:55:59.641037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-35469524-58e4-4064-9dac-ecae7f67095b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:55:59.671357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:59.752005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35469524-58e4-4064-9dac-ecae7f67095b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:55:59.753639 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35469524-58e4-4064-9dac-ecae7f67095b service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:55:59.787376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 693/1403] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:01.901225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e596-5c11-4c9f-9f67-4ffea77f07f4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.901783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e596-5c11-4c9f-9f67-4ffea77f07f4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.901783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e596-5c11-4c9f-9f67-4ffea77f07f4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.903128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 711/1404] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:01.908380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57084-4fd4-408c-afdb-02758303f554 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:01.908823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57084-4fd4-408c-afdb-02758303f554 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:01.909046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c57084-4fd4-408c-afdb-02758303f554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:01.986662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-92c57084-4fd4-408c-afdb-02758303f554 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:01.988031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-92c57084-4fd4-408c-afdb-02758303f554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:02.099580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:02.106343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 694/1405] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:02.410271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e596-5c11-4c9f-9f67-4ffea77f07f4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:02.411793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-82d8e596-5c11-4c9f-9f67-4ffea77f07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:02.631538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e596-5c11-4c9f-9f67-4ffea77f07f4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:02.718204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:02.794058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bd886-5f2d-4cbc-811d-b5e7e5342f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:02.794716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bd886-5f2d-4cbc-811d-b5e7e5342f40 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:02.794997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bd886-5f2d-4cbc-811d-b5e7e5342f40 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:02.795280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bd886-5f2d-4cbc-811d-b5e7e5342f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:02.796898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a90bd886-5f2d-4cbc-811d-b5e7e5342f40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:02.898092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bd886-5f2d-4cbc-811d-b5e7e5342f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:02.900047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bd886-5f2d-4cbc-811d-b5e7e5342f40 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:02.919624 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 712/1406] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:05.270376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32daea8-644c-44cb-91dd-351b3b575ffb None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:05.270963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32daea8-644c-44cb-91dd-351b3b575ffb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:05.270963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32daea8-644c-44cb-91dd-351b3b575ffb None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:05.272264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 695/1407] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:05.278270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdb7dd-d0f7-441b-801f-785bb294b2bd None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:05.278737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdb7dd-d0f7-441b-801f-785bb294b2bd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:05.278827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdb7dd-d0f7-441b-801f-785bb294b2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:05.353855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0ecdb7dd-d0f7-441b-801f-785bb294b2bd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:05.355476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0ecdb7dd-d0f7-441b-801f-785bb294b2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:05.374500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:05.473716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 713/1408] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:05.764350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32daea8-644c-44cb-91dd-351b3b575ffb None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:05.768340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f32daea8-644c-44cb-91dd-351b3b575ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:05.931615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32daea8-644c-44cb-91dd-351b3b575ffb None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:06.003481 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:06.056183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37e442-d596-44a5-bc94-60543430ce95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:06.056891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37e442-d596-44a5-bc94-60543430ce95 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:06.057174 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37e442-d596-44a5-bc94-60543430ce95 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:06.057448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37e442-d596-44a5-bc94-60543430ce95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:06.059131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ea37e442-d596-44a5-bc94-60543430ce95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:06.159211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37e442-d596-44a5-bc94-60543430ce95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:06.160835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37e442-d596-44a5-bc94-60543430ce95 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:06.179871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 696/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:15.472022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=38 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:16.177039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=64 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:21.967149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d180-e784-4fd8-b022-dfc2bc08b920 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:21.967684 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d180-e784-4fd8-b022-dfc2bc08b920 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:21.967684 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d180-e784-4fd8-b022-dfc2bc08b920 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:21.969025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 714/1410] 10.222.0.58 () {54 vars in 918 bytes} [Wed Aug 24 07:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:21.974316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9f94-73f0-4d59-a143-7003482bbaa4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:21.974781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9f94-73f0-4d59-a143-7003482bbaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:21.974895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9f94-73f0-4d59-a143-7003482bbaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:22.049040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7aad9f94-73f0-4d59-a143-7003482bbaa4 None None] MFA Rules not processed for user `00093949026746f29def86e4a0b48bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:22.050175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7aad9f94-73f0-4d59-a143-7003482bbaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:22.158641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 697/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Aug 24 07:56:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:22.172918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74325c-56a3-4026-b91e-1d472dfbd809 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:22.173195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74325c-56a3-4026-b91e-1d472dfbd809 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:22.173475 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74325c-56a3-4026-b91e-1d472dfbd809 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:22.174800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 715/1412] 10.222.0.58 () {54 vars in 918 bytes} [Wed Aug 24 07:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:22.179249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb7d4-5ec7-46d5-a48c-235a45e5fb5b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:22.179529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb7d4-5ec7-46d5-a48c-235a45e5fb5b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:22.179823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb7d4-5ec7-46d5-a48c-235a45e5fb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:22.250384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:22.252908 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-25adb7d4-5ec7-46d5-a48c-235a45e5fb5b None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:22.254127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-25adb7d4-5ec7-46d5-a48c-235a45e5fb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:22.369764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 698/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Aug 24 07:56:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:24.786793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3840ba-0988-49b2-924c-128c52eca9cf None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:24.787323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3840ba-0988-49b2-924c-128c52eca9cf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:24.787323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3840ba-0988-49b2-924c-128c52eca9cf None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:24.788637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:24.794432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519dfe8-a6ef-4db2-a7e1-1dd6270b95ae None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:24.794835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519dfe8-a6ef-4db2-a7e1-1dd6270b95ae None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:24.794984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519dfe8-a6ef-4db2-a7e1-1dd6270b95ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:24.860398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f519dfe8-a6ef-4db2-a7e1-1dd6270b95ae None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:24.861643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f519dfe8-a6ef-4db2-a7e1-1dd6270b95ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:24.916661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:24.958376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:25.252542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3840ba-0988-49b2-924c-128c52eca9cf None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:25.254082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bd3840ba-0988-49b2-924c-128c52eca9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:25.397817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3840ba-0988-49b2-924c-128c52eca9cf None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:25.468513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:25.511910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf4ca1-adae-42a6-86fc-8c5b967c3285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:25.512494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf4ca1-adae-42a6-86fc-8c5b967c3285 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:25.512847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf4ca1-adae-42a6-86fc-8c5b967c3285 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:25.513143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf4ca1-adae-42a6-86fc-8c5b967c3285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:25.514850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3dbf4ca1-adae-42a6-86fc-8c5b967c3285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:25.604368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf4ca1-adae-42a6-86fc-8c5b967c3285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:25.605994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf4ca1-adae-42a6-86fc-8c5b967c3285 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:25.624534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 717/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:26.514565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b11345-5bb1-4ce0-ba70-7ac1f9c7da40 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:26.515393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b11345-5bb1-4ce0-ba70-7ac1f9c7da40 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:26.515393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b11345-5bb1-4ce0-ba70-7ac1f9c7da40 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:26.516799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:26.521735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8920e7-77a3-40c7-bc32-868eac4bfbb8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:26.522135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8920e7-77a3-40c7-bc32-868eac4bfbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:26.522279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8920e7-77a3-40c7-bc32-868eac4bfbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:26.599472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1a8920e7-77a3-40c7-bc32-868eac4bfbb8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:26.600679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1a8920e7-77a3-40c7-bc32-868eac4bfbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:26.628498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:26.697765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:26.848211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b11345-5bb1-4ce0-ba70-7ac1f9c7da40 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:26.849854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a9b11345-5bb1-4ce0-ba70-7ac1f9c7da40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:26.997680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b11345-5bb1-4ce0-ba70-7ac1f9c7da40 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:27.037333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:27.109871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b57c8-da83-4a7a-b828-2f496581018b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:27.110473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b57c8-da83-4a7a-b828-2f496581018b service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:27.110747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b57c8-da83-4a7a-b828-2f496581018b service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:27.111013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b57c8-da83-4a7a-b828-2f496581018b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:27.112598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b84b57c8-da83-4a7a-b828-2f496581018b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:27.199992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b57c8-da83-4a7a-b828-2f496581018b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:27.201624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b57c8-da83-4a7a-b828-2f496581018b service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:27.219709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 701/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:28.110473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f4c85-58e5-4e3a-bfb6-653eb555472d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.111028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f4c85-58e5-4e3a-bfb6-653eb555472d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.111028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f4c85-58e5-4e3a-bfb6-653eb555472d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.112376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:28.117563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaafaa7-13a9-49ba-9169-7909a131a34c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.118111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaafaa7-13a9-49ba-9169-7909a131a34c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.118510 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaafaa7-13a9-49ba-9169-7909a131a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.172824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:28.193890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-afaafaa7-13a9-49ba-9169-7909a131a34c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:28.195099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-afaafaa7-13a9-49ba-9169-7909a131a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:28.291185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:28.442304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f4c85-58e5-4e3a-bfb6-653eb555472d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:28.443910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6b2f4c85-58e5-4e3a-bfb6-653eb555472d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:28.588682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f4c85-58e5-4e3a-bfb6-653eb555472d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:28.600414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:28.701215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56356f33-665b-4e7a-a8a0-073f890d6f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:28.701759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56356f33-665b-4e7a-a8a0-073f890d6f3c service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:28.702041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56356f33-665b-4e7a-a8a0-073f890d6f3c service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:28.702309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56356f33-665b-4e7a-a8a0-073f890d6f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:28.703902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-56356f33-665b-4e7a-a8a0-073f890d6f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:28.792961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56356f33-665b-4e7a-a8a0-073f890d6f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:28.794566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56356f33-665b-4e7a-a8a0-073f890d6f3c service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:28.813001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 720/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:29.677906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007a45-c760-4feb-b682-486c769eb66a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.678710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007a45-c760-4feb-b682-486c769eb66a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.678710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab007a45-c760-4feb-b682-486c769eb66a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.680466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:29.685602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a649d-78da-4da5-86dc-6359055ff4be None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:29.686071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a649d-78da-4da5-86dc-6359055ff4be None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:29.686176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a649d-78da-4da5-86dc-6359055ff4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:29.705686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:29.762363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-489a649d-78da-4da5-86dc-6359055ff4be None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:29.763571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-489a649d-78da-4da5-86dc-6359055ff4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:29.860069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:30.011263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab007a45-c760-4feb-b682-486c769eb66a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:30.012750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ab007a45-c760-4feb-b682-486c769eb66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:30.122745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:30.160064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab007a45-c760-4feb-b682-486c769eb66a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:30.393135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d203ad-3a96-4b8b-a372-001e7c8a885c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:30.393772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d203ad-3a96-4b8b-a372-001e7c8a885c service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:30.394048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d203ad-3a96-4b8b-a372-001e7c8a885c service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:30.394311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d203ad-3a96-4b8b-a372-001e7c8a885c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:30.395896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-63d203ad-3a96-4b8b-a372-001e7c8a885c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:30.471461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:30.484729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d203ad-3a96-4b8b-a372-001e7c8a885c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:30.486376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d203ad-3a96-4b8b-a372-001e7c8a885c service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:30.504220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 704/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:31.364379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30dda-596c-47b3-9b13-05e415651d49 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.364920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30dda-596c-47b3-9b13-05e415651d49 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.364920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f30dda-596c-47b3-9b13-05e415651d49 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.366256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:31.371899 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea62d-ef1d-4667-82fe-a0be10d4c947 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.372292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea62d-ef1d-4667-82fe-a0be10d4c947 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.372439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ea62d-ef1d-4667-82fe-a0be10d4c947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.449795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b04ea62d-ef1d-4667-82fe-a0be10d4c947 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:31.450987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b04ea62d-ef1d-4667-82fe-a0be10d4c947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:31.546098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:31.698436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f30dda-596c-47b3-9b13-05e415651d49 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:31.699906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-62f30dda-596c-47b3-9b13-05e415651d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:31.784396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:31.851113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f30dda-596c-47b3-9b13-05e415651d49 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:31.962703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049a8e7-4dcb-4a55-b877-f5dee5fbd413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:31.963235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049a8e7-4dcb-4a55-b877-f5dee5fbd413 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:31.963515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049a8e7-4dcb-4a55-b877-f5dee5fbd413 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:31.963786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049a8e7-4dcb-4a55-b877-f5dee5fbd413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:31.965394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1049a8e7-4dcb-4a55-b877-f5dee5fbd413 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:32.014290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:32.055802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049a8e7-4dcb-4a55-b877-f5dee5fbd413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:32.057394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049a8e7-4dcb-4a55-b877-f5dee5fbd413 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:32.075214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 723/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:32.934828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dbc2c-e74a-4680-8113-13b5fc30d6af None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:32.935357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dbc2c-e74a-4680-8113-13b5fc30d6af None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:32.935357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dbc2c-e74a-4680-8113-13b5fc30d6af None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:32.936608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:32.941580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23726188-8d63-4670-99d8-865c98b737c0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:32.941985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23726188-8d63-4670-99d8-865c98b737c0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:32.942120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23726188-8d63-4670-99d8-865c98b737c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:33.018629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-23726188-8d63-4670-99d8-865c98b737c0 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:33.019824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-23726188-8d63-4670-99d8-865c98b737c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:33.113768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:33.266970 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dbc2c-e74a-4680-8113-13b5fc30d6af None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:33.268428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ab7dbc2c-e74a-4680-8113-13b5fc30d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:33.316579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:33.414253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dbc2c-e74a-4680-8113-13b5fc30d6af None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:33.526093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd180f0-e0c8-4d60-b21f-ffff2085b7ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:33.526620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd180f0-e0c8-4d60-b21f-ffff2085b7ca service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:33.526895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd180f0-e0c8-4d60-b21f-ffff2085b7ca service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:33.527165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd180f0-e0c8-4d60-b21f-ffff2085b7ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:33.528786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0cd180f0-e0c8-4d60-b21f-ffff2085b7ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:33.535732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:33.617765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd180f0-e0c8-4d60-b21f-ffff2085b7ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:33.619448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd180f0-e0c8-4d60-b21f-ffff2085b7ca service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:33.637744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 707/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:34.514278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f145320-a487-400e-8e7b-597faed81b15 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:34.515091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f145320-a487-400e-8e7b-597faed81b15 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:34.515091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f145320-a487-400e-8e7b-597faed81b15 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:34.516364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:34.521236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe169194-f80a-483d-a7ab-0b42b270d6c7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:34.521731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe169194-f80a-483d-a7ab-0b42b270d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:34.521835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe169194-f80a-483d-a7ab-0b42b270d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:34.598103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fe169194-f80a-483d-a7ab-0b42b270d6c7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:34.599299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fe169194-f80a-483d-a7ab-0b42b270d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:34.666457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:34.694676 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:34.845965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f145320-a487-400e-8e7b-597faed81b15 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:34.847492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2f145320-a487-400e-8e7b-597faed81b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:34.865532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:34.997918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f145320-a487-400e-8e7b-597faed81b15 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:35.085103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:35.111296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd1449-e7a7-472e-81de-043a7d8562dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:35.111869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd1449-e7a7-472e-81de-043a7d8562dc service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:35.112264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd1449-e7a7-472e-81de-043a7d8562dc service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:35.112534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd1449-e7a7-472e-81de-043a7d8562dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:35.114167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d5fd1449-e7a7-472e-81de-043a7d8562dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:35.202322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd1449-e7a7-472e-81de-043a7d8562dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:35.203912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd1449-e7a7-472e-81de-043a7d8562dc service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:35.221998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 726/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:36.084214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d488a0-6c31-4126-a564-cb08918aeb2c None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:36.084766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d488a0-6c31-4126-a564-cb08918aeb2c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:36.084766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d488a0-6c31-4126-a564-cb08918aeb2c None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:36.086583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:36.091670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad571cd-f9c7-4a64-a83d-a5952a523e2d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:36.092092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad571cd-f9c7-4a64-a83d-a5952a523e2d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:36.092225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad571cd-f9c7-4a64-a83d-a5952a523e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:36.170124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9ad571cd-f9c7-4a64-a83d-a5952a523e2d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:36.171337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9ad571cd-f9c7-4a64-a83d-a5952a523e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:36.212077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:36.266395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:36.424177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d488a0-6c31-4126-a564-cb08918aeb2c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:36.425752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-17d488a0-6c31-4126-a564-cb08918aeb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:36.572206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d488a0-6c31-4126-a564-cb08918aeb2c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:36.626570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:36.691610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a3507-d163-460e-8998-22cc9e3fe817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:36.692316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3507-d163-460e-8998-22cc9e3fe817 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:36.692590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3507-d163-460e-8998-22cc9e3fe817 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:36.692850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3507-d163-460e-8998-22cc9e3fe817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:36.694497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f04a3507-d163-460e-8998-22cc9e3fe817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:36.783081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a3507-d163-460e-8998-22cc9e3fe817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:36.784632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a3507-d163-460e-8998-22cc9e3fe817 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:36.802942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 710/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:37.678998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68ebd-4065-4ee0-b0e0-73f8b49df105 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.680168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68ebd-4065-4ee0-b0e0-73f8b49df105 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.680168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68ebd-4065-4ee0-b0e0-73f8b49df105 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.681328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 07:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:37.686210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7d95f-3a30-48fc-9ea2-5aeab2d08b50 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:37.686638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7d95f-3a30-48fc-9ea2-5aeab2d08b50 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:37.686755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7d95f-3a30-48fc-9ea2-5aeab2d08b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:37.760746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-24d7d95f-3a30-48fc-9ea2-5aeab2d08b50 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:37.761970 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-24d7d95f-3a30-48fc-9ea2-5aeab2d08b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:37.763952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:37.859473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 07:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:38.012877 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68ebd-4065-4ee0-b0e0-73f8b49df105 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:38.014369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c5e68ebd-4065-4ee0-b0e0-73f8b49df105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:38.162030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68ebd-4065-4ee0-b0e0-73f8b49df105 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:38.188946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:38.275001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1132bc-18b4-4c21-a98c-ea748be6bec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:38.275533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1132bc-18b4-4c21-a98c-ea748be6bec3 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:38.275804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1132bc-18b4-4c21-a98c-ea748be6bec3 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:38.276080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1132bc-18b4-4c21-a98c-ea748be6bec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:38.277703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fd1132bc-18b4-4c21-a98c-ea748be6bec3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:38.369722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1132bc-18b4-4c21-a98c-ea748be6bec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:38.371340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1132bc-18b4-4c21-a98c-ea748be6bec3 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:38.390197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 729/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:40.200574 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace0314-5e75-4eda-9e75-447a179b1fa5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:40.201137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace0314-5e75-4eda-9e75-447a179b1fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:40.201137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace0314-5e75-4eda-9e75-447a179b1fa5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:40.202506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:40.207752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350717dd-1957-4cba-af50-3efad4e98975 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:40.208206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350717dd-1957-4cba-af50-3efad4e98975 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:40.208316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350717dd-1957-4cba-af50-3efad4e98975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:40.248387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:40.274729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-350717dd-1957-4cba-af50-3efad4e98975 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:40.275922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-350717dd-1957-4cba-af50-3efad4e98975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:40.377101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:56:40.679347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace0314-5e75-4eda-9e75-447a179b1fa5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:40.681119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0ace0314-5e75-4eda-9e75-447a179b1fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:40.785253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace0314-5e75-4eda-9e75-447a179b1fa5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:40.817399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:40.859757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233fc4b-fd0b-4e18-82d6-c6fc61da6054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:40.860343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233fc4b-fd0b-4e18-82d6-c6fc61da6054 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:40.860612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233fc4b-fd0b-4e18-82d6-c6fc61da6054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:40.860876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233fc4b-fd0b-4e18-82d6-c6fc61da6054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:40.862463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4233fc4b-fd0b-4e18-82d6-c6fc61da6054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:40.968813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233fc4b-fd0b-4e18-82d6-c6fc61da6054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:40.970235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233fc4b-fd0b-4e18-82d6-c6fc61da6054 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:40.988185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 713/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:43.038311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035b607-a419-4842-a4ff-7cc84f42de33 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:43.038849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035b607-a419-4842-a4ff-7cc84f42de33 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:43.038849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035b607-a419-4842-a4ff-7cc84f42de33 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:43.040326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:43.045626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c548e-9ce3-41ab-8b25-a8cc0d960532 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:43.046014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c548e-9ce3-41ab-8b25-a8cc0d960532 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:43.046171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c548e-9ce3-41ab-8b25-a8cc0d960532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:43.110614 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4c2c548e-9ce3-41ab-8b25-a8cc0d960532 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:43.111794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4c2c548e-9ce3-41ab-8b25-a8cc0d960532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:43.124259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:43.208314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:43.503730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035b607-a419-4842-a4ff-7cc84f42de33 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:43.505253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4035b607-a419-4842-a4ff-7cc84f42de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:43.610472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035b607-a419-4842-a4ff-7cc84f42de33 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:43.623344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:43.684425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446e946-f9d1-4df3-99d8-15b49020d765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:43.685023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446e946-f9d1-4df3-99d8-15b49020d765 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:43.685295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446e946-f9d1-4df3-99d8-15b49020d765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:43.685588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446e946-f9d1-4df3-99d8-15b49020d765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:43.687182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7446e946-f9d1-4df3-99d8-15b49020d765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:43.794347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446e946-f9d1-4df3-99d8-15b49020d765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:43.795864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446e946-f9d1-4df3-99d8-15b49020d765 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:43.814517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 732/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:46.147594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55292-37be-46ff-937c-da8fc0d0d3fe None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.148103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55292-37be-46ff-937c-da8fc0d0d3fe None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.148103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55292-37be-46ff-937c-da8fc0d0d3fe None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.149448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:46.155290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f77d9-e061-4611-8a08-71f4f29bdcda None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.155690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f77d9-e061-4611-8a08-71f4f29bdcda None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.155860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f77d9-e061-4611-8a08-71f4f29bdcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.203883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:46.221778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7a7f77d9-e061-4611-8a08-71f4f29bdcda None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:46.222991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7a7f77d9-e061-4611-8a08-71f4f29bdcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:46.319114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:46.601500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55292-37be-46ff-937c-da8fc0d0d3fe None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:46.603009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-12c55292-37be-46ff-937c-da8fc0d0d3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:46.708011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55292-37be-46ff-937c-da8fc0d0d3fe None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:46.747484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:46.780489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b729b78-5652-46f7-a790-c6585966b19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:46.781089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729b78-5652-46f7-a790-c6585966b19e service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:46.781369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729b78-5652-46f7-a790-c6585966b19e service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:46.781656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b729b78-5652-46f7-a790-c6585966b19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:46.783233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3b729b78-5652-46f7-a790-c6585966b19e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:46.891446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729b78-5652-46f7-a790-c6585966b19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:46.892790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b729b78-5652-46f7-a790-c6585966b19e service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:46.910996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 716/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:48.958127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525a906-e597-4819-8c97-75e83b376490 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:48.958670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525a906-e597-4819-8c97-75e83b376490 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:48.958670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525a906-e597-4819-8c97-75e83b376490 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:48.959997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:48.965416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fb59c-aa5a-4602-a58f-4720a1c48928 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:48.965857 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fb59c-aa5a-4602-a58f-4720a1c48928 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:48.965981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fb59c-aa5a-4602-a58f-4720a1c48928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:49.031008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9c0fb59c-aa5a-4602-a58f-4720a1c48928 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:49.032196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9c0fb59c-aa5a-4602-a58f-4720a1c48928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:49.052378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:49.127681 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:49.411259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525a906-e597-4819-8c97-75e83b376490 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:49.412832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f525a906-e597-4819-8c97-75e83b376490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:49.523461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525a906-e597-4819-8c97-75e83b376490 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:49.544160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:49.597241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a4411-147a-41d4-b45e-b37faf90cfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:49.597863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4411-147a-41d4-b45e-b37faf90cfbb service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:49.598137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4411-147a-41d4-b45e-b37faf90cfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:49.598400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a4411-147a-41d4-b45e-b37faf90cfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:49.599974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f33a4411-147a-41d4-b45e-b37faf90cfbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:49.712814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a4411-147a-41d4-b45e-b37faf90cfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:49.714196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a4411-147a-41d4-b45e-b37faf90cfbb service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:49.731923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 735/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:51.686454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc241caa-7bb4-4867-95d2-7d29c2c44a2d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:51.686984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc241caa-7bb4-4867-95d2-7d29c2c44a2d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:51.686984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc241caa-7bb4-4867-95d2-7d29c2c44a2d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:51.688275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:51.693618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83074c03-6b47-4e31-a0af-3d57b04939e8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:51.694039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83074c03-6b47-4e31-a0af-3d57b04939e8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:51.694157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83074c03-6b47-4e31-a0af-3d57b04939e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:51.756059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:51.758651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-83074c03-6b47-4e31-a0af-3d57b04939e8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:51.759832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-83074c03-6b47-4e31-a0af-3d57b04939e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:51.856366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:52.137556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc241caa-7bb4-4867-95d2-7d29c2c44a2d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:52.139078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dc241caa-7bb4-4867-95d2-7d29c2c44a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:52.240778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc241caa-7bb4-4867-95d2-7d29c2c44a2d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:52.291994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:52.316446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90447611-16af-4e72-a580-49066a43dd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:52.317044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90447611-16af-4e72-a580-49066a43dd30 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:52.317317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90447611-16af-4e72-a580-49066a43dd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:52.317615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90447611-16af-4e72-a580-49066a43dd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:52.319561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-90447611-16af-4e72-a580-49066a43dd30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:52.429535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90447611-16af-4e72-a580-49066a43dd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:52.430915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90447611-16af-4e72-a580-49066a43dd30 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:52.448803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 719/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:54.419513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8191a-c9d1-40b0-92d8-8862eae078e8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:54.420044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8191a-c9d1-40b0-92d8-8862eae078e8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:54.420044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8191a-c9d1-40b0-92d8-8862eae078e8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:54.421409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:54.427010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575fc0-82a7-4def-8b07-e7817e77dbd2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:54.427434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575fc0-82a7-4def-8b07-e7817e77dbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:54.427573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30575fc0-82a7-4def-8b07-e7817e77dbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:54.494698 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-30575fc0-82a7-4def-8b07-e7817e77dbd2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:54.495888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-30575fc0-82a7-4def-8b07-e7817e77dbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:54.526075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:54.593192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:54.877737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8191a-c9d1-40b0-92d8-8862eae078e8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:54.879310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-40d8191a-c9d1-40b0-92d8-8862eae078e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:54.984023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8191a-c9d1-40b0-92d8-8862eae078e8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:55.012218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:55.058266 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2111fb-d957-4e2d-9e7d-9e3befc2a6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:55.058868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2111fb-d957-4e2d-9e7d-9e3befc2a6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:55.059144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2111fb-d957-4e2d-9e7d-9e3befc2a6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:55.059416 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2111fb-d957-4e2d-9e7d-9e3befc2a6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:55.061029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cb2111fb-d957-4e2d-9e7d-9e3befc2a6d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:55.168848 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2111fb-d957-4e2d-9e7d-9e3befc2a6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:55.170307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2111fb-d957-4e2d-9e7d-9e3befc2a6d8 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:55.188462 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 738/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:57.172061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577e208-984a-4451-8d2d-35684a089138 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:57.172602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577e208-984a-4451-8d2d-35684a089138 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:57.172602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577e208-984a-4451-8d2d-35684a089138 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:57.173974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:57.179356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4578-58b5-4150-bbcf-0064914587f2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:57.179766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4578-58b5-4150-bbcf-0064914587f2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:57.179876 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4578-58b5-4150-bbcf-0064914587f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:57.246449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-064a4578-58b5-4150-bbcf-0064914587f2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:57.247640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-064a4578-58b5-4150-bbcf-0064914587f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:57.255751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:57.347078 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:56:57.637098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577e208-984a-4451-8d2d-35684a089138 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:56:57.638700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0577e208-984a-4451-8d2d-35684a089138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:57.740081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577e208-984a-4451-8d2d-35684a089138 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:56:57.795002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:57.814984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcf1fb-ac58-4951-a0fd-983c430e482a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:56:57.815588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcf1fb-ac58-4951-a0fd-983c430e482a service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:57.815867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcf1fb-ac58-4951-a0fd-983c430e482a service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:57.816136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcf1fb-ac58-4951-a0fd-983c430e482a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:57.817759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-efbcf1fb-ac58-4951-a0fd-983c430e482a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:56:57.925810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcf1fb-ac58-4951-a0fd-983c430e482a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:56:57.927165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcf1fb-ac58-4951-a0fd-983c430e482a service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:56:57.945281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 722/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:56:59.886156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b1724-3ef7-4e4b-8663-4ae803b04dca None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:59.886659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b1724-3ef7-4e4b-8663-4ae803b04dca None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:59.886659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b1724-3ef7-4e4b-8663-4ae803b04dca None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:59.888042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:56:59.893945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eefb6-952d-4c97-9b0c-532074369691 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:56:59.894359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eefb6-952d-4c97-9b0c-532074369691 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:56:59.894470 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eefb6-952d-4c97-9b0c-532074369691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:56:59.960662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c13eefb6-952d-4c97-9b0c-532074369691 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:56:59.961898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c13eefb6-952d-4c97-9b0c-532074369691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:00.000073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:00.058484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:57:00.344517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b1724-3ef7-4e4b-8663-4ae803b04dca None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:00.346083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2a1b1724-3ef7-4e4b-8663-4ae803b04dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:00.450256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b1724-3ef7-4e4b-8663-4ae803b04dca None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:00.488210 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:00.525176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a2430-197c-4461-a66a-39ad576de4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:00.525804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a2430-197c-4461-a66a-39ad576de4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:00.526078 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a2430-197c-4461-a66a-39ad576de4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:00.526342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a2430-197c-4461-a66a-39ad576de4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:00.528086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-131a2430-197c-4461-a66a-39ad576de4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:00.636979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a2430-197c-4461-a66a-39ad576de4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:00.638338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a2430-197c-4461-a66a-39ad576de4a4 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:00.656827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 741/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:02.672378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf59739-a699-46f5-a564-a1716ef5aafd None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:02.672763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf59739-a699-46f5-a564-a1716ef5aafd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:02.672938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf59739-a699-46f5-a564-a1716ef5aafd None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:02.674342 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:02.680802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c5981-fbef-4f67-9f75-374c2fd1aa4f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:02.681267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c5981-fbef-4f67-9f75-374c2fd1aa4f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:02.681419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c5981-fbef-4f67-9f75-374c2fd1aa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:02.746636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f58c5981-fbef-4f67-9f75-374c2fd1aa4f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:02.747848 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f58c5981-fbef-4f67-9f75-374c2fd1aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:02.765870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:02.844547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:03.132297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf59739-a699-46f5-a564-a1716ef5aafd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:03.133863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cbf59739-a699-46f5-a564-a1716ef5aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:03.236121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf59739-a699-46f5-a564-a1716ef5aafd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:03.305140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:03.312097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7217-2b58-4e23-9247-e0ae217f8fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:03.312703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7217-2b58-4e23-9247-e0ae217f8fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:03.312980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7217-2b58-4e23-9247-e0ae217f8fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:03.313250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7217-2b58-4e23-9247-e0ae217f8fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:03.314926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-da7f7217-2b58-4e23-9247-e0ae217f8fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:03.424708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7217-2b58-4e23-9247-e0ae217f8fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:03.426110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7217-2b58-4e23-9247-e0ae217f8fb5 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:03.446096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 725/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:05.409140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38639f-8433-423d-89e0-487877586496 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.409741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38639f-8433-423d-89e0-487877586496 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.409741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38639f-8433-423d-89e0-487877586496 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.411042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 07:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:05.417236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4a047-de59-4539-887d-b35cee1d544a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:05.417723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4a047-de59-4539-887d-b35cee1d544a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:05.417823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4a047-de59-4539-887d-b35cee1d544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:05.482941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e3c4a047-de59-4539-887d-b35cee1d544a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:05.484137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e3c4a047-de59-4539-887d-b35cee1d544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:05.534166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:05.583281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 07:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:05.867204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38639f-8433-423d-89e0-487877586496 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:05.868763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7e38639f-8433-423d-89e0-487877586496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:05.970979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38639f-8433-423d-89e0-487877586496 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:06.017711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:06.044169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2b4e0-a1c4-4052-99af-e624159940ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:06.044771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b4e0-a1c4-4052-99af-e624159940ab service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:06.045046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b4e0-a1c4-4052-99af-e624159940ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:06.045316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2b4e0-a1c4-4052-99af-e624159940ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:06.046947 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c6b2b4e0-a1c4-4052-99af-e624159940ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:06.274692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2b4e0-a1c4-4052-99af-e624159940ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:06.276030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2b4e0-a1c4-4052-99af-e624159940ab service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:06.293937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 744/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:15.581474 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=22 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:16.291719 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=66 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:26.575633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e6e3b-c9ec-4a11-a2df-6a40a2e880de None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:26.576190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e6e3b-c9ec-4a11-a2df-6a40a2e880de None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:26.576190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e6e3b-c9ec-4a11-a2df-6a40a2e880de None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:26.577532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 727/1471] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:26.583087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55911f0-3e56-4bbe-aab6-9f8e164fe7c8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:26.583493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55911f0-3e56-4bbe-aab6-9f8e164fe7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:26.583629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55911f0-3e56-4bbe-aab6-9f8e164fe7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:26.648710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a55911f0-3e56-4bbe-aab6-9f8e164fe7c8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:26.649849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a55911f0-3e56-4bbe-aab6-9f8e164fe7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:26.742688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 745/1472] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:27.039634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2c291-6174-4968-ad24-ca398082ed33 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:27.039913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2c291-6174-4968-ad24-ca398082ed33 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:27.040212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2c291-6174-4968-ad24-ca398082ed33 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:27.041564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 728/1473] 10.222.0.58 () {54 vars in 967 bytes} [Wed Aug 24 07:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:27.046512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568103-b68e-4139-856e-0a3dda7fe8ed None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:27.046802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568103-b68e-4139-856e-0a3dda7fe8ed None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:27.047074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01568103-b68e-4139-856e-0a3dda7fe8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:27.125080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-01568103-b68e-4139-856e-0a3dda7fe8ed None None] MFA Rules not processed for user `79bb81300cff46b7ba1680eedf2762cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:27.126327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-01568103-b68e-4139-856e-0a3dda7fe8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:27.147222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:27.202499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 746/1474] 10.222.0.58 () {58 vars in 1064 bytes} [Wed Aug 24 07:57:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:27.210699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2c291-6174-4968-ad24-ca398082ed33 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:27.212211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dfe2c291-6174-4968-ad24-ca398082ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:27.316843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2c291-6174-4968-ad24-ca398082ed33 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:27.398997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55c6cd-6680-4fec-87b2-c5a13b16548b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79bb81300cff46b7ba1680eedf2762cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:27.399602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c6cd-6680-4fec-87b2-c5a13b16548b service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:27.399874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c6cd-6680-4fec-87b2-c5a13b16548b service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:27.400139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c6cd-6680-4fec-87b2-c5a13b16548b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:27.401756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fb55c6cd-6680-4fec-87b2-c5a13b16548b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:27.455630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:27.511636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55c6cd-6680-4fec-87b2-c5a13b16548b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:27.513060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55c6cd-6680-4fec-87b2-c5a13b16548b service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:27.532674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 729/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:29.523618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb33a-5ab7-4217-8471-ed47a3e8054c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:29.524181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb33a-5ab7-4217-8471-ed47a3e8054c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:29.524181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb33a-5ab7-4217-8471-ed47a3e8054c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:29.525515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 747/1476] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:29.530757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0a995-998c-4109-b74f-bfce3dc8eb85 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:29.531204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0a995-998c-4109-b74f-bfce3dc8eb85 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:29.531311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0a995-998c-4109-b74f-bfce3dc8eb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:29.598748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-35a0a995-998c-4109-b74f-bfce3dc8eb85 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:29.600579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-35a0a995-998c-4109-b74f-bfce3dc8eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:29.696178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 730/1477] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:29.968732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb33a-5ab7-4217-8471-ed47a3e8054c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:29.970233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5b6cb33a-5ab7-4217-8471-ed47a3e8054c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:30.093603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb33a-5ab7-4217-8471-ed47a3e8054c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:30.141114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:30.184177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e925b5-653f-4a93-b796-e51d09c5f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:30.184776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e925b5-653f-4a93-b796-e51d09c5f63d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:30.185046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e925b5-653f-4a93-b796-e51d09c5f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:30.185304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e925b5-653f-4a93-b796-e51d09c5f63d admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:30.185958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e925b5-653f-4a93-b796-e51d09c5f63d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:30.187672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-b9e925b5-653f-4a93-b796-e51d09c5f63d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:57:30.187672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: warnings.warn(msg) Aug 24 07:57:30.187672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: Aug 24 07:57:30.188799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e925b5-653f-4a93-b796-e51d09c5f63d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:30.207274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 748/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 07:57:29 2022] GET /identity/v3/projects => generated 2553 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:57:32.182939 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8ed49-d92b-44db-b641-1a7579cf49d9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:32.183456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8ed49-d92b-44db-b641-1a7579cf49d9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:32.183456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8ed49-d92b-44db-b641-1a7579cf49d9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:32.184750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 731/1479] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:32.190084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2a516-9142-4bb1-8481-6193b064c94c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:32.190603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2a516-9142-4bb1-8481-6193b064c94c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:32.190603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2a516-9142-4bb1-8481-6193b064c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:32.254966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2ea2a516-9142-4bb1-8481-6193b064c94c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:32.256840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2ea2a516-9142-4bb1-8481-6193b064c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:32.352368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 749/1480] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:32.645685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8ed49-d92b-44db-b641-1a7579cf49d9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:32.646066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9bc8ed49-d92b-44db-b641-1a7579cf49d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:32.656472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:32.792096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8ed49-d92b-44db-b641-1a7579cf49d9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:32.871506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:32.905000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb1d3e-9467-4fc9-a55e-67ec19e18c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:32.905665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1d3e-9467-4fc9-a55e-67ec19e18c45 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:32.905943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1d3e-9467-4fc9-a55e-67ec19e18c45 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:32.906216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1d3e-9467-4fc9-a55e-67ec19e18c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:32.907810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2dcb1d3e-9467-4fc9-a55e-67ec19e18c45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:32.994833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1d3e-9467-4fc9-a55e-67ec19e18c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:32.996432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1d3e-9467-4fc9-a55e-67ec19e18c45 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:33.014930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 732/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:35.114205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e49d6-719e-468b-b17f-19f67c9aa84e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.114770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e49d6-719e-468b-b17f-19f67c9aa84e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.114770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e49d6-719e-468b-b17f-19f67c9aa84e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.116116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 750/1482] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:35.121358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6333fc-089d-453f-b06f-e4dd5e22ff00 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.121859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6333fc-089d-453f-b06f-e4dd5e22ff00 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.121959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6333fc-089d-453f-b06f-e4dd5e22ff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.188250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9a6333fc-089d-453f-b06f-e4dd5e22ff00 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:35.189445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9a6333fc-089d-453f-b06f-e4dd5e22ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:35.234483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:35.283610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 733/1483] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:35.570841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e49d6-719e-468b-b17f-19f67c9aa84e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:35.572370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-129e49d6-719e-468b-b17f-19f67c9aa84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:35.596066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:35.675603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e49d6-719e-468b-b17f-19f67c9aa84e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:35.749338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf0b87-5274-49b8-ac1f-3ed72aef5c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:35.749970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf0b87-5274-49b8-ac1f-3ed72aef5c94 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:35.750239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf0b87-5274-49b8-ac1f-3ed72aef5c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:35.750499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf0b87-5274-49b8-ac1f-3ed72aef5c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:35.752127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4edf0b87-5274-49b8-ac1f-3ed72aef5c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:35.826216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:35.864564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf0b87-5274-49b8-ac1f-3ed72aef5c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:35.866067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf0b87-5274-49b8-ac1f-3ed72aef5c94 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:35.884867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 751/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:37.850529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a136f-0641-48c4-812f-13ad17365058 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.851026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a136f-0641-48c4-812f-13ad17365058 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.851134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a136f-0641-48c4-812f-13ad17365058 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.852470 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 734/1485] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:37.857802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285fbea-dd1f-4fc6-8bad-043d612ba3c9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:37.858203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285fbea-dd1f-4fc6-8bad-043d612ba3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:37.858347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285fbea-dd1f-4fc6-8bad-043d612ba3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:37.923923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4285fbea-dd1f-4fc6-8bad-043d612ba3c9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:37.925149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4285fbea-dd1f-4fc6-8bad-043d612ba3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:38.022943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 752/1486] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:38.310255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a136f-0641-48c4-812f-13ad17365058 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:38.311830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-153a136f-0641-48c4-812f-13ad17365058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:38.416978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a136f-0641-48c4-812f-13ad17365058 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:38.487828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:38.489611 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1afd9-478f-42b0-bd8f-f7e9f5f441cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:38.490835 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1afd9-478f-42b0-bd8f-f7e9f5f441cf service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:38.491111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1afd9-478f-42b0-bd8f-f7e9f5f441cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:38.491383 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1afd9-478f-42b0-bd8f-f7e9f5f441cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:38.493062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f3c1afd9-478f-42b0-bd8f-f7e9f5f441cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:38.602406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1afd9-478f-42b0-bd8f-f7e9f5f441cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:38.603762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1afd9-478f-42b0-bd8f-f7e9f5f441cf service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:38.622183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 735/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:40.696895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e758dd3-bb8e-4c80-9592-334b9313484e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:40.697416 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e758dd3-bb8e-4c80-9592-334b9313484e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:40.697416 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e758dd3-bb8e-4c80-9592-334b9313484e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:40.698739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 753/1488] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:40.703988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07ccf-e563-4274-bb92-54649a59baaa None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:40.704386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07ccf-e563-4274-bb92-54649a59baaa None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:40.704541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07ccf-e563-4274-bb92-54649a59baaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:40.769069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e9b07ccf-e563-4274-bb92-54649a59baaa None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:40.770286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e9b07ccf-e563-4274-bb92-54649a59baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:40.822283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:40.869741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 736/1489] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:41.168735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e758dd3-bb8e-4c80-9592-334b9313484e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:41.170304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1e758dd3-bb8e-4c80-9592-334b9313484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:41.206151 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:41.273359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e758dd3-bb8e-4c80-9592-334b9313484e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:41.347893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9714200-08ac-43c6-9ddc-bebbb1e540bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:41.348626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9714200-08ac-43c6-9ddc-bebbb1e540bf service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:41.348835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9714200-08ac-43c6-9ddc-bebbb1e540bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:41.349136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9714200-08ac-43c6-9ddc-bebbb1e540bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:41.351426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c9714200-08ac-43c6-9ddc-bebbb1e540bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:41.432290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:41.461932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9714200-08ac-43c6-9ddc-bebbb1e540bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:41.463617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9714200-08ac-43c6-9ddc-bebbb1e540bf service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:41.481160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 754/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:43.776739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079140b-1291-4ea4-8c7d-7a7822053abd None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.777265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079140b-1291-4ea4-8c7d-7a7822053abd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.777265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079140b-1291-4ea4-8c7d-7a7822053abd None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.778603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 737/1491] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 07:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:57:43.783752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbe6c2-5e82-4a6c-8164-74fabf4cf575 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:43.784188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbe6c2-5e82-4a6c-8164-74fabf4cf575 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:43.784294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbe6c2-5e82-4a6c-8164-74fabf4cf575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:43.849511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6bcbe6c2-5e82-4a6c-8164-74fabf4cf575 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:57:43.850806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6bcbe6c2-5e82-4a6c-8164-74fabf4cf575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:43.946078 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 755/1492] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 07:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:57:44.235155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079140b-1291-4ea4-8c7d-7a7822053abd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:57:44.236763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b079140b-1291-4ea4-8c7d-7a7822053abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.340002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079140b-1291-4ea4-8c7d-7a7822053abd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:57:44.413069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312cca0-751d-4f50-853e-4e1d05421dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:57:44.413703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312cca0-751d-4f50-853e-4e1d05421dcd service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:57:44.413985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312cca0-751d-4f50-853e-4e1d05421dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:57:44.414251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312cca0-751d-4f50-853e-4e1d05421dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:57:44.415844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b312cca0-751d-4f50-853e-4e1d05421dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:57:44.424756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:44.525913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312cca0-751d-4f50-853e-4e1d05421dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:57:44.527300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312cca0-751d-4f50-853e-4e1d05421dcd service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:57:44.545840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 738/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:57:53.944255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=82 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:54.543603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=50 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:10.492075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa220f-313c-4d42-91ac-23cf6e9bbebe None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:10.492660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa220f-313c-4d42-91ac-23cf6e9bbebe None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:10.492660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa220f-313c-4d42-91ac-23cf6e9bbebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:10.569101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-acfa220f-313c-4d42-91ac-23cf6e9bbebe None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:10.570336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-acfa220f-313c-4d42-91ac-23cf6e9bbebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:10.669274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 756/1494] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 07:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:10.677604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fc75d-ae00-4313-9497-93f6ae8d7369 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:10.678119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fc75d-ae00-4313-9497-93f6ae8d7369 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:10.678234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fc75d-ae00-4313-9497-93f6ae8d7369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:10.752366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b07fc75d-ae00-4313-9497-93f6ae8d7369 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:10.753594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b07fc75d-ae00-4313-9497-93f6ae8d7369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:10.849112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 739/1495] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 07:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:10.853821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa220f-313c-4d42-91ac-23cf6e9bbebe None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:10.855044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-acfa220f-313c-4d42-91ac-23cf6e9bbebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:10.866358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa220f-313c-4d42-91ac-23cf6e9bbebe None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:10.926859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:10.960587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:10.961178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:10.961446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:10.961740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:10.962372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:59:10.962666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:10.963656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:59:10.963656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: warnings.warn(msg) Aug 24 07:59:10.963656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: Aug 24 07:59:10.964524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:10.975970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 757/1496] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 07:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:59:10.984303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fc75d-ae00-4313-9497-93f6ae8d7369 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:10.993965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fc75d-ae00-4313-9497-93f6ae8d7369 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:11.055628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:11.088878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:11.089506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:11.089923 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:11.090052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:11.090654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:11.092463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:59:11.092463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: warnings.warn(msg) Aug 24 07:59:11.092463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: Aug 24 07:59:11.093726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:11.226191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 740/1497] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 07:59:10 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:11.230243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:11.231826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:11.264468 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb856aaf-e26b-42bc-be4d-06ac19e967ca admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:11.357905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:11.358564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:11.358845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:11.359113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:11.359750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:11.364114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:59:11.364114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: warnings.warn(msg) Aug 24 07:59:11.364114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: Aug 24 07:59:11.364114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:11.470826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 758/1498] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 07:59:11 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:59:11.475123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:11.476698 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:11.537310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875660ca-ef00-47d6-8ba1-32e0ec7e4829 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:11.621229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:11.632339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:11.638991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:11.638991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:11.638991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:11.638991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:11.638991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:59:11.638991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: warnings.warn(msg) Aug 24 07:59:11.638991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: Aug 24 07:59:11.639593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:11.649605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 741/1499] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:11.653781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:11.655279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:11.666751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58941211-f2ef-4630-a31d-d333fd94b872 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:11.691567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:11.760266 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590ea3-304a-49ce-ac08-6b02c86dc7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:11.761043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590ea3-304a-49ce-ac08-6b02c86dc7dd admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:11.761317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590ea3-304a-49ce-ac08-6b02c86dc7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:11.761613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590ea3-304a-49ce-ac08-6b02c86dc7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:11.762242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590ea3-304a-49ce-ac08-6b02c86dc7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:11.763233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-04590ea3-304a-49ce-ac08-6b02c86dc7dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:59:11.763233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: warnings.warn(msg) Aug 24 07:59:11.763233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: Aug 24 07:59:11.764104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590ea3-304a-49ce-ac08-6b02c86dc7dd admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:11.776383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 759/1500] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 07:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:59:11.780564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:11.782130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:11.816216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bb0ad-70fe-46eb-a454-eec53de3f10f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:11.909450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64051e3-6f69-4c44-97ae-3f66b6ca1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:11.910129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64051e3-6f69-4c44-97ae-3f66b6ca1ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:11.910400 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64051e3-6f69-4c44-97ae-3f66b6ca1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:11.910664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64051e3-6f69-4c44-97ae-3f66b6ca1ddd admin admin] PATH_INFO: `/v3/projects/301c0adfa7bf485eb8014b6402693ed1/users/b6640ec1174647608e5e39d48a76b129/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:11.932798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64051e3-6f69-4c44-97ae-3f66b6ca1ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=301c0adfa7bf485eb8014b6402693ed1, user_id=b6640ec1174647608e5e39d48a76b129, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:11.933841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-b64051e3-6f69-4c44-97ae-3f66b6ca1ddd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:59:11.933841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: warnings.warn(msg) Aug 24 07:59:11.933841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: Aug 24 07:59:11.935766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64051e3-6f69-4c44-97ae-3f66b6ca1ddd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:12.058518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 742/1501] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 07:59:11 2022] PUT /identity/v3/projects/301c0adfa7bf485eb8014b6402693ed1/users/b6640ec1174647608e5e39d48a76b129/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:12.071413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfee42a-2a96-4b8d-80d6-4b13e6a44530 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:12.071702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfee42a-2a96-4b8d-80d6-4b13e6a44530 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:12.071976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfee42a-2a96-4b8d-80d6-4b13e6a44530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:12.128859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0dfee42a-2a96-4b8d-80d6-4b13e6a44530 None None] MFA Rules not processed for user `b6640ec1174647608e5e39d48a76b129`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:12.130186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0dfee42a-2a96-4b8d-80d6-4b13e6a44530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:12.207842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 760/1502] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 07:59:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:59:12.221689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592efd-8464-45fe-9ab6-b3f09f47c283 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:12.221978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592efd-8464-45fe-9ab6-b3f09f47c283 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:12.222256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592efd-8464-45fe-9ab6-b3f09f47c283 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:12.223643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 743/1503] 10.222.0.58 () {54 vars in 964 bytes} [Wed Aug 24 07:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:59:12.229130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770d8e2-0058-4d75-882e-e4835b4b384a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:12.229413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770d8e2-0058-4d75-882e-e4835b4b384a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:12.229711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770d8e2-0058-4d75-882e-e4835b4b384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:12.260658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:12.306072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f770d8e2-0058-4d75-882e-e4835b4b384a None None] MFA Rules not processed for user `23734a2b701a46c3a25ae547aff98026`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:12.307274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f770d8e2-0058-4d75-882e-e4835b4b384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:12.382791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 761/1504] 10.222.0.58 () {58 vars in 1061 bytes} [Wed Aug 24 07:59:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:59:12.390781 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592efd-8464-45fe-9ab6-b3f09f47c283 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:12.392290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0c592efd-8464-45fe-9ab6-b3f09f47c283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:12.442612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:12.501066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592efd-8464-45fe-9ab6-b3f09f47c283 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:12.579245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:12.579842 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:12.580115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:12.580388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:12.582005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:12.682250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:12.683677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:12.687208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:12.701126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 744/1505] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:12.756662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94e54b-137c-42f1-b162-118d0ee5cc0e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:12.757082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94e54b-137c-42f1-b162-118d0ee5cc0e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:12.757207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94e54b-137c-42f1-b162-118d0ee5cc0e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:12.758508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 762/1506] 10.222.0.58 () {52 vars in 830 bytes} [Wed Aug 24 07:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:59:12.762415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:12.763613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:12.863580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3478d-500b-4148-975a-bf1af61578fa service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:12.955978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:12.956529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:12.956866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:12.957147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] PATH_INFO: `/v3/users/b6640ec1174647608e5e39d48a76b129` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:12.970168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6640ec1174647608e5e39d48a76b129)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:12.971176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:59:12.971176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: warnings.warn(msg) Aug 24 07:59:12.971176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: Aug 24 07:59:12.972373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:12.981902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:13.180317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6640ec1174647608e5e39d48a76b129'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:13.194580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6640ec1174647608e5e39d48a76b129'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:13.195123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6640ec1174647608e5e39d48a76b129'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:13.195541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6640ec1174647608e5e39d48a76b129'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:13.286281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6640ec1174647608e5e39d48a76b129'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:13.316633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 745/1507] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 07:59:12 2022] DELETE /identity/v3/users/b6640ec1174647608e5e39d48a76b129 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:59:13.321763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414465da-f870-4451-ab52-49ca35fb7a70 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:13.322040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414465da-f870-4451-ab52-49ca35fb7a70 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:13.322307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414465da-f870-4451-ab52-49ca35fb7a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:13.379996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-414465da-f870-4451-ab52-49ca35fb7a70 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:59:13.381197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-414465da-f870-4451-ab52-49ca35fb7a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:13.456168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:13.471759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 763/1508] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 07:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:59:13.484113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:13.487165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:13.591700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbc69c-64b4-4dfe-b11b-c78c52c82dfe admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:13.646892 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:13.665883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03458bfb-9f77-42ec-8b4d-5f4e3e41d542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:13.666490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03458bfb-9f77-42ec-8b4d-5f4e3e41d542 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:13.666766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03458bfb-9f77-42ec-8b4d-5f4e3e41d542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:13.667033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03458bfb-9f77-42ec-8b4d-5f4e3e41d542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:13.668618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-03458bfb-9f77-42ec-8b4d-5f4e3e41d542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:13.775562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03458bfb-9f77-42ec-8b4d-5f4e3e41d542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:13.776982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03458bfb-9f77-42ec-8b4d-5f4e3e41d542 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:13.795541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 746/1509] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 07:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:59:14.298071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414465da-f870-4451-ab52-49ca35fb7a70 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:59:14.299308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-414465da-f870-4451-ab52-49ca35fb7a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:59:14.311059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414465da-f870-4451-ab52-49ca35fb7a70 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:59:14.411787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:59:14.412422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:59:14.412701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:59:14.413013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] PATH_INFO: `/v3/projects/301c0adfa7bf485eb8014b6402693ed1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:59:14.422746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301c0adfa7bf485eb8014b6402693ed1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:59:14.423766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:59:14.423766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: warnings.warn(msg) Aug 24 07:59:14.423766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: Aug 24 07:59:14.424964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:59:14.536842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301c0adfa7bf485eb8014b6402693ed1', 'request_id': 'req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:14.543090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301c0adfa7bf485eb8014b6402693ed1', 'request_id': 'req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:14.557993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301c0adfa7bf485eb8014b6402693ed1', 'request_id': 'req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:14.651245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] The token cache is being invalidate because project 301c0adfa7bf485eb8014b6402693ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:59:14.651527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:14.651945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2a945056-33d5-4dc0-b0c1-a7bd9d32cb54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:59:14.653379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 764/1510] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 07:59:14 2022] DELETE /identity/v3/projects/301c0adfa7bf485eb8014b6402693ed1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:59:23.793408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=62 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:59:24.648968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:47.249660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b28b9a-32dc-4eb4-84ee-8d26bad8a106 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:47.250267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b28b9a-32dc-4eb4-84ee-8d26bad8a106 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:47.250267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b28b9a-32dc-4eb4-84ee-8d26bad8a106 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:47.251554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:47.256447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab1847-e440-479b-9fd6-70f35cbb02b2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:47.256920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab1847-e440-479b-9fd6-70f35cbb02b2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:47.257031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab1847-e440-479b-9fd6-70f35cbb02b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:47.339178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d2ab1847-e440-479b-9fd6-70f35cbb02b2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:47.340651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d2ab1847-e440-479b-9fd6-70f35cbb02b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:47.443134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:47.597621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b28b9a-32dc-4eb4-84ee-8d26bad8a106 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:47.599976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-27b28b9a-32dc-4eb4-84ee-8d26bad8a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:47.715768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b28b9a-32dc-4eb4-84ee-8d26bad8a106 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:47.721486 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb869389-7e3a-4b30-a825-728ed25c6837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:47.722096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb869389-7e3a-4b30-a825-728ed25c6837 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:47.722355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb869389-7e3a-4b30-a825-728ed25c6837 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:47.722620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb869389-7e3a-4b30-a825-728ed25c6837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:47.730334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb869389-7e3a-4b30-a825-728ed25c6837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:47.731913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb869389-7e3a-4b30-a825-728ed25c6837 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:47.741101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 748/1513] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:48.568673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3668d-1f0c-4e1b-93b5-a82202acd027 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:48.569241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3668d-1f0c-4e1b-93b5-a82202acd027 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:48.569241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3668d-1f0c-4e1b-93b5-a82202acd027 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:48.570590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:48.575449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5924d6-9097-4dac-9350-410d0e596493 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:48.575864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5924d6-9097-4dac-9350-410d0e596493 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:48.576014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5924d6-9097-4dac-9350-410d0e596493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:48.595542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-aa5924d6-9097-4dac-9350-410d0e596493 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:48.596728 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aa5924d6-9097-4dac-9350-410d0e596493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:48.604653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:00:48.758951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3668d-1f0c-4e1b-93b5-a82202acd027 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:48.773316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3668d-1f0c-4e1b-93b5-a82202acd027 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:48.778758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3d513-128e-4710-ac09-1d1749defa95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:48.779481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3d513-128e-4710-ac09-1d1749defa95 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:48.779763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3d513-128e-4710-ac09-1d1749defa95 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:48.780102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3d513-128e-4710-ac09-1d1749defa95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:48.788143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3d513-128e-4710-ac09-1d1749defa95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:48.789755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3d513-128e-4710-ac09-1d1749defa95 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:48.799844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 767/1516] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:49.245348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5581b3-fd7d-4fb0-8abe-257363884815 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:49.245656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5581b3-fd7d-4fb0-8abe-257363884815 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:49.245924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5581b3-fd7d-4fb0-8abe-257363884815 None None] PATH_INFO: `/v3` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:49.247206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 750/1517] 10.222.0.49 () {54 vars in 925 bytes} [Wed Aug 24 08:00:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:00:49.254728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102f709-6bc1-4dfd-945f-b7587495c8f5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:49.255016 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102f709-6bc1-4dfd-945f-b7587495c8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:49.255291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102f709-6bc1-4dfd-945f-b7587495c8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:49.314715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d102f709-6bc1-4dfd-945f-b7587495c8f5 None None] MFA Rules not processed for user `00093949026746f29def86e4a0b48bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:49.315921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d102f709-6bc1-4dfd-945f-b7587495c8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:49.333590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:49.388125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 768/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 24 08:00:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:58.590578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=56 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:58.782033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce096e-60ad-4bd3-bf66-2baf7e060988 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:58.782242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce096e-60ad-4bd3-bf66-2baf7e060988 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:58.782479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce096e-60ad-4bd3-bf66-2baf7e060988 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:58.783795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 751/1519] 10.222.0.58 () {54 vars in 961 bytes} [Wed Aug 24 08:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:58.788594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75115-e268-4e96-bbe2-d3b85bbdc3c3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:58.789029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75115-e268-4e96-bbe2-d3b85bbdc3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:58.789174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75115-e268-4e96-bbe2-d3b85bbdc3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:58.808693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-27e75115-e268-4e96-bbe2-d3b85bbdc3c3 None None] MFA Rules not processed for user `00093949026746f29def86e4a0b48bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:58.809914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-27e75115-e268-4e96-bbe2-d3b85bbdc3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:58.819470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 769/1520] 10.222.0.58 () {58 vars in 1058 bytes} [Wed Aug 24 08:00:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:58.826903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce096e-60ad-4bd3-bf66-2baf7e060988 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:58.840618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce096e-60ad-4bd3-bf66-2baf7e060988 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:58.845555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9357-617c-4eb0-b713-7858d61053b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:58.846141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9357-617c-4eb0-b713-7858d61053b2 service placement] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:58.846419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9357-617c-4eb0-b713-7858d61053b2 service placement] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:58.846693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9357-617c-4eb0-b713-7858d61053b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:58.854707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9357-617c-4eb0-b713-7858d61053b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:58.856281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9357-617c-4eb0-b713-7858d61053b2 service placement] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:58.865859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 752/1521] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:59.994077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df365f65-c83f-4457-8ae7-5e00da7981e8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:59.994554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df365f65-c83f-4457-8ae7-5e00da7981e8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:59.994653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df365f65-c83f-4457-8ae7-5e00da7981e8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:59.996042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:00.000757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d238b-090d-4812-b634-d54a0784a830 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:00.001195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d238b-090d-4812-b634-d54a0784a830 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:00.001330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d238b-090d-4812-b634-d54a0784a830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:00.022161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-092d238b-090d-4812-b634-d54a0784a830 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:00.023353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-092d238b-090d-4812-b634-d54a0784a830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:00.032008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:00.185167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df365f65-c83f-4457-8ae7-5e00da7981e8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:00.200214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df365f65-c83f-4457-8ae7-5e00da7981e8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:00.206235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c14eb-9d1f-4ae0-abe6-cda27e39ab1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:00.206833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c14eb-9d1f-4ae0-abe6-cda27e39ab1f service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:00.207111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c14eb-9d1f-4ae0-abe6-cda27e39ab1f service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:00.207387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c14eb-9d1f-4ae0-abe6-cda27e39ab1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:00.215649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c14eb-9d1f-4ae0-abe6-cda27e39ab1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:00.217229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c14eb-9d1f-4ae0-abe6-cda27e39ab1f service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:00.226702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 771/1524] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:01.039403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b623ea-dfed-4d01-ad17-dbad0995392d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:01.040018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b623ea-dfed-4d01-ad17-dbad0995392d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:01.040018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b623ea-dfed-4d01-ad17-dbad0995392d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:01.041350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:01.047216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af1c29-287b-4066-8264-7d7a3dce7249 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:01.047785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af1c29-287b-4066-8264-7d7a3dce7249 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:01.047785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af1c29-287b-4066-8264-7d7a3dce7249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:01.067654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f5af1c29-287b-4066-8264-7d7a3dce7249 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:01.068971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f5af1c29-287b-4066-8264-7d7a3dce7249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:01.077582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:01.230525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b623ea-dfed-4d01-ad17-dbad0995392d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:01.244797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b623ea-dfed-4d01-ad17-dbad0995392d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:01.251044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f4f9d-1dc6-4a13-aba1-69f0a1b5fcad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:01.251667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f4f9d-1dc6-4a13-aba1-69f0a1b5fcad service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:01.251947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f4f9d-1dc6-4a13-aba1-69f0a1b5fcad service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:01.252214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f4f9d-1dc6-4a13-aba1-69f0a1b5fcad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:01.261020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f4f9d-1dc6-4a13-aba1-69f0a1b5fcad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:01.262629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f4f9d-1dc6-4a13-aba1-69f0a1b5fcad service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:01.272732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 755/1527] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:01:05.194073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70d6f8-b90e-45e5-824b-78a887ad3369 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:05.194610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70d6f8-b90e-45e5-824b-78a887ad3369 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:05.194610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70d6f8-b90e-45e5-824b-78a887ad3369 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:05.195950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:05.201230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d9e55-44ae-4229-8e1e-9de20d53a866 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:05.201769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d9e55-44ae-4229-8e1e-9de20d53a866 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:05.201890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d9e55-44ae-4229-8e1e-9de20d53a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:05.220719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-946d9e55-44ae-4229-8e1e-9de20d53a866 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:05.221936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-946d9e55-44ae-4229-8e1e-9de20d53a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:05.229647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:05.520094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70d6f8-b90e-45e5-824b-78a887ad3369 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:05.521853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-de70d6f8-b90e-45e5-824b-78a887ad3369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:05.602675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70d6f8-b90e-45e5-824b-78a887ad3369 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:05.606261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cf124-9ec3-4afd-86c5-e692415dc76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:05.606859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf124-9ec3-4afd-86c5-e692415dc76c service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:05.607132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf124-9ec3-4afd-86c5-e692415dc76c service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:05.607396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cf124-9ec3-4afd-86c5-e692415dc76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:05.616691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cf124-9ec3-4afd-86c5-e692415dc76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:05.618153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cf124-9ec3-4afd-86c5-e692415dc76c service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:05.627423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 774/1530] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:07.738143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f012fa-a580-4b7c-9e17-bf981bc1ac33 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:07.738656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f012fa-a580-4b7c-9e17-bf981bc1ac33 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:07.738656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f012fa-a580-4b7c-9e17-bf981bc1ac33 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:07.739982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:07.745415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12330b-11fc-4cb1-8e0f-84ea7f793dee None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:07.745899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12330b-11fc-4cb1-8e0f-84ea7f793dee None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:07.746006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12330b-11fc-4cb1-8e0f-84ea7f793dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:07.766610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0b12330b-11fc-4cb1-8e0f-84ea7f793dee None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:07.767783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0b12330b-11fc-4cb1-8e0f-84ea7f793dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:07.775387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:08.073412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f012fa-a580-4b7c-9e17-bf981bc1ac33 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:08.075114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e1f012fa-a580-4b7c-9e17-bf981bc1ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:08.088138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f012fa-a580-4b7c-9e17-bf981bc1ac33 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:08.091627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eb20c-e325-468f-90bf-66cb934d0748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:08.092234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eb20c-e325-468f-90bf-66cb934d0748 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:08.092515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eb20c-e325-468f-90bf-66cb934d0748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:08.092784 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eb20c-e325-468f-90bf-66cb934d0748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:08.101446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eb20c-e325-468f-90bf-66cb934d0748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:08.102876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eb20c-e325-468f-90bf-66cb934d0748 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:08.112583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 758/1533] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:11.565298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf082-7c06-4cc3-a7ee-5faf58825988 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:11.565886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf082-7c06-4cc3-a7ee-5faf58825988 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:11.565886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaf082-7c06-4cc3-a7ee-5faf58825988 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:11.567238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:11.572464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48386f7f-1ef1-4fef-ac47-86378e8c5274 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:11.572899 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48386f7f-1ef1-4fef-ac47-86378e8c5274 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:11.573006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48386f7f-1ef1-4fef-ac47-86378e8c5274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:11.591888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-48386f7f-1ef1-4fef-ac47-86378e8c5274 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:11.593700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-48386f7f-1ef1-4fef-ac47-86378e8c5274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:11.601346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:01:12.151921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaf082-7c06-4cc3-a7ee-5faf58825988 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:12.153677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fcfaf082-7c06-4cc3-a7ee-5faf58825988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:12.219022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:12.231675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaf082-7c06-4cc3-a7ee-5faf58825988 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:12.235800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab65d6-8aec-4284-b288-d998f4c651a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:12.244567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab65d6-8aec-4284-b288-d998f4c651a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:12.244567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab65d6-8aec-4284-b288-d998f4c651a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:12.244567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab65d6-8aec-4284-b288-d998f4c651a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:12.245808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab65d6-8aec-4284-b288-d998f4c651a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:12.247221 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab65d6-8aec-4284-b288-d998f4c651a4 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:12.258311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 777/1536] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:14.168255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27330e95-56a8-4bdd-a4aa-701c6bf55e74 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:14.168804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27330e95-56a8-4bdd-a4aa-701c6bf55e74 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:14.168804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27330e95-56a8-4bdd-a4aa-701c6bf55e74 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:14.171287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:14.176510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eb32f-c8e1-43f3-803a-85b6e1d85d25 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:14.176911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eb32f-c8e1-43f3-803a-85b6e1d85d25 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:14.177060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eb32f-c8e1-43f3-803a-85b6e1d85d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:14.197415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-537eb32f-c8e1-43f3-803a-85b6e1d85d25 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:14.198638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-537eb32f-c8e1-43f3-803a-85b6e1d85d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:14.209270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:14.758879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27330e95-56a8-4bdd-a4aa-701c6bf55e74 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:14.760641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-27330e95-56a8-4bdd-a4aa-701c6bf55e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:14.774151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27330e95-56a8-4bdd-a4aa-701c6bf55e74 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:14.777625 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8752cf-d6d5-4496-af1c-17f312ec2f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:14.778209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8752cf-d6d5-4496-af1c-17f312ec2f6e service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:14.778484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8752cf-d6d5-4496-af1c-17f312ec2f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:14.778750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8752cf-d6d5-4496-af1c-17f312ec2f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:14.787376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8752cf-d6d5-4496-af1c-17f312ec2f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:14.788783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8752cf-d6d5-4496-af1c-17f312ec2f6e service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:14.798533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 761/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:24.192628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=11 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:24.794413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=33 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:40.225380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2355919-5521-4fc4-9fca-bd814ba8f16c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.226038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2355919-5521-4fc4-9fca-bd814ba8f16c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.226038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2355919-5521-4fc4-9fca-bd814ba8f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.251610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f2355919-5521-4fc4-9fca-bd814ba8f16c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:40.252994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f2355919-5521-4fc4-9fca-bd814ba8f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:40.262080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 779/1540] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:40.270531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae475b6-360e-4f30-80fe-40dc0f0b1d4c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.271618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae475b6-360e-4f30-80fe-40dc0f0b1d4c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.272121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae475b6-360e-4f30-80fe-40dc0f0b1d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.300122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1ae475b6-360e-4f30-80fe-40dc0f0b1d4c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:40.302093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1ae475b6-360e-4f30-80fe-40dc0f0b1d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:40.316432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 762/1541] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:40.323531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2355919-5521-4fc4-9fca-bd814ba8f16c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:40.337046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2355919-5521-4fc4-9fca-bd814ba8f16c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:40.344021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88daa-1adf-4e9c-a23d-68756785f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:40.344760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88daa-1adf-4e9c-a23d-68756785f2fc admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.345045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88daa-1adf-4e9c-a23d-68756785f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.345483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88daa-1adf-4e9c-a23d-68756785f2fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.346140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88daa-1adf-4e9c-a23d-68756785f2fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:02:40.346437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88daa-1adf-4e9c-a23d-68756785f2fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:40.348034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88daa-1adf-4e9c-a23d-68756785f2fc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:40.364294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 780/1542] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:02:40.372332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae475b6-360e-4f30-80fe-40dc0f0b1d4c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:40.388179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae475b6-360e-4f30-80fe-40dc0f0b1d4c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:40.399627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2aeb7b-2176-4ed3-93cf-097f4ea0df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:40.400571 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2aeb7b-2176-4ed3-93cf-097f4ea0df34 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.401260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2aeb7b-2176-4ed3-93cf-097f4ea0df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.401938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2aeb7b-2176-4ed3-93cf-097f4ea0df34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.403585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2aeb7b-2176-4ed3-93cf-097f4ea0df34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:40.406043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2aeb7b-2176-4ed3-93cf-097f4ea0df34 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:40.561432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 763/1543] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:40 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:40.566213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88daa-1adf-4e9c-a23d-68756785f2fc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:40.582053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88daa-1adf-4e9c-a23d-68756785f2fc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:40.660014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11b1a-6b22-4dc1-b9a5-7be44715c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:40.660673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11b1a-6b22-4dc1-b9a5-7be44715c312 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.660957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11b1a-6b22-4dc1-b9a5-7be44715c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.661230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11b1a-6b22-4dc1-b9a5-7be44715c312 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.661961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b11b1a-6b22-4dc1-b9a5-7be44715c312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:40.664075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b11b1a-6b22-4dc1-b9a5-7be44715c312 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:40.788147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 781/1544] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:40 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:40.792212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2aeb7b-2176-4ed3-93cf-097f4ea0df34 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:40.807042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2aeb7b-2176-4ed3-93cf-097f4ea0df34 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:40.815969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae22baf-7cbc-4b08-817a-b9fa78f8c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:40.817004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae22baf-7cbc-4b08-817a-b9fa78f8c8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.817532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae22baf-7cbc-4b08-817a-b9fa78f8c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.818026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae22baf-7cbc-4b08-817a-b9fa78f8c8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.818902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae22baf-7cbc-4b08-817a-b9fa78f8c8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:40.820770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae22baf-7cbc-4b08-817a-b9fa78f8c8b6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:40.839163 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 764/1545] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:40.843263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11b1a-6b22-4dc1-b9a5-7be44715c312 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:40.856397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11b1a-6b22-4dc1-b9a5-7be44715c312 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:40.864620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a03c1e-cb85-475c-b88a-9a612090942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:40.865237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a03c1e-cb85-475c-b88a-9a612090942d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.865653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a03c1e-cb85-475c-b88a-9a612090942d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.865988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a03c1e-cb85-475c-b88a-9a612090942d admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.866643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a03c1e-cb85-475c-b88a-9a612090942d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:40.868260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a03c1e-cb85-475c-b88a-9a612090942d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:40.890390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 782/1546] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:40.894472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae22baf-7cbc-4b08-817a-b9fa78f8c8b6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:40.911880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae22baf-7cbc-4b08-817a-b9fa78f8c8b6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:40.918698 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d751ff8-808a-4e66-af07-34e85361cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:40.919746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d751ff8-808a-4e66-af07-34e85361cfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.920260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d751ff8-808a-4e66-af07-34e85361cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.920752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d751ff8-808a-4e66-af07-34e85361cfb9 admin admin] PATH_INFO: `/v3/projects/66d1e29bdbed410db1d4c9710b08cbad/users/37e7ea97f58341fc99b168ee30503594/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.948451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d751ff8-808a-4e66-af07-34e85361cfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d1e29bdbed410db1d4c9710b08cbad, user_id=37e7ea97f58341fc99b168ee30503594, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:40.952648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d751ff8-808a-4e66-af07-34e85361cfb9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:40.982118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8024467-5970-4fd5-a0d7-9a902c09da72 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.982482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8024467-5970-4fd5-a0d7-9a902c09da72 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.982753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8024467-5970-4fd5-a0d7-9a902c09da72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.018206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f8024467-5970-4fd5-a0d7-9a902c09da72 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.020135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f8024467-5970-4fd5-a0d7-9a902c09da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.034312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 783/1547] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:02:41.044966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b43af4-1c24-4500-bbc3-16a84a476716 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.045187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b43af4-1c24-4500-bbc3-16a84a476716 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.045412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b43af4-1c24-4500-bbc3-16a84a476716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.047028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 765/1548] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:40 2022] PUT /identity/v3/projects/66d1e29bdbed410db1d4c9710b08cbad/users/37e7ea97f58341fc99b168ee30503594/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:41.051970 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fa458-883d-469b-bf76-4f921d596486 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.052679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fa458-883d-469b-bf76-4f921d596486 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.053338 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fa458-883d-469b-bf76-4f921d596486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.083110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-58b43af4-1c24-4500-bbc3-16a84a476716 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.084347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-58b43af4-1c24-4500-bbc3-16a84a476716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.086762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b34fa458-883d-469b-bf76-4f921d596486 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.088256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b34fa458-883d-469b-bf76-4f921d596486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.212531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 766/1549] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.214031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ccc16-cad9-418f-bc71-a7771732d0fe None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.214436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ccc16-cad9-418f-bc71-a7771732d0fe None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.214557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 784/1550] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.214738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ccc16-cad9-418f-bc71-a7771732d0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.219696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b43af4-1c24-4500-bbc3-16a84a476716 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.248876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9a8ccc16-cad9-418f-bc71-a7771732d0fe None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.250154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9a8ccc16-cad9-418f-bc71-a7771732d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.252642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b43af4-1c24-4500-bbc3-16a84a476716 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.264746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 767/1551] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.265656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ccc16-cad9-418f-bc71-a7771732d0fe None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.276329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13188f-962a-463b-abe1-ff005d859c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.276954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13188f-962a-463b-abe1-ff005d859c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.277227 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13188f-962a-463b-abe1-ff005d859c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.278247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13188f-962a-463b-abe1-ff005d859c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.278929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13188f-962a-463b-abe1-ff005d859c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:02:41.279323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13188f-962a-463b-abe1-ff005d859c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.280924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13188f-962a-463b-abe1-ff005d859c12 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.323426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 785/1552] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:02:41.324654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a2fd-caff-4f5e-93e2-211f3d578909 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.324945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a2fd-caff-4f5e-93e2-211f3d578909 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.325225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5a2fd-caff-4f5e-93e2-211f3d578909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.375940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-eca5a2fd-caff-4f5e-93e2-211f3d578909 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.377150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-eca5a2fd-caff-4f5e-93e2-211f3d578909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.395509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ccc16-cad9-418f-bc71-a7771732d0fe None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.396144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 786/1553] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.396812 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5a2fd-caff-4f5e-93e2-211f3d578909 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.404163 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb8f41-756c-4b99-87b6-ef3a24f9d428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.404847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8f41-756c-4b99-87b6-ef3a24f9d428 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.405417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8f41-756c-4b99-87b6-ef3a24f9d428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.405812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8f41-756c-4b99-87b6-ef3a24f9d428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.407449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5a2fd-caff-4f5e-93e2-211f3d578909 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.412454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33893394-05d1-4df3-a4f2-168e4ae9ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.413047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33893394-05d1-4df3-a4f2-168e4ae9ad47 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.413887 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33893394-05d1-4df3-a4f2-168e4ae9ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.414161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33893394-05d1-4df3-a4f2-168e4ae9ad47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.414786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33893394-05d1-4df3-a4f2-168e4ae9ad47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.415664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb8f41-756c-4b99-87b6-ef3a24f9d428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.415782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-33893394-05d1-4df3-a4f2-168e4ae9ad47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:02:41.415782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: warnings.warn(msg) Aug 24 08:02:41.415782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: Aug 24 08:02:41.416978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33893394-05d1-4df3-a4f2-168e4ae9ad47 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.417262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb8f41-756c-4b99-87b6-ef3a24f9d428 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.429446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 768/1554] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:41.431224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785193-ac6c-41db-82e9-7b1dfbd390b6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.431793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785193-ac6c-41db-82e9-7b1dfbd390b6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.432067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785193-ac6c-41db-82e9-7b1dfbd390b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.456868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9d785193-ac6c-41db-82e9-7b1dfbd390b6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.458165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9d785193-ac6c-41db-82e9-7b1dfbd390b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.466665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 769/1555] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.467849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad6bcb-62a6-4d76-80d6-99a56318a085 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.468127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad6bcb-62a6-4d76-80d6-99a56318a085 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.468407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad6bcb-62a6-4d76-80d6-99a56318a085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.488005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6dad6bcb-62a6-4d76-80d6-99a56318a085 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.489184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6dad6bcb-62a6-4d76-80d6-99a56318a085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.498349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 770/1556] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.499620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f81d57-d117-4662-b6ed-d0dd5a920dfc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.499905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f81d57-d117-4662-b6ed-d0dd5a920dfc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.500172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f81d57-d117-4662-b6ed-d0dd5a920dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.503633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 787/1557] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:41.507913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33893394-05d1-4df3-a4f2-168e4ae9ad47 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.521088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:41.522631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a8f81d57-d117-4662-b6ed-d0dd5a920dfc None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.523828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a8f81d57-d117-4662-b6ed-d0dd5a920dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.530047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:41.581138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33893394-05d1-4df3-a4f2-168e4ae9ad47 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.586842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31288147-5f19-4614-bef7-aba505d481d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.587461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31288147-5f19-4614-bef7-aba505d481d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.587739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31288147-5f19-4614-bef7-aba505d481d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.595923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31288147-5f19-4614-bef7-aba505d481d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.596071 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 771/1558] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.596443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31288147-5f19-4614-bef7-aba505d481d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:02:41.596443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31288147-5f19-4614-bef7-aba505d481d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.596631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97cd3-0fd5-4e77-ac76-c2d6b115336d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.596631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97cd3-0fd5-4e77-ac76-c2d6b115336d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.596631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97cd3-0fd5-4e77-ac76-c2d6b115336d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.596869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31288147-5f19-4614-bef7-aba505d481d8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.603934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 788/1559] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:02:41.605260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ae84c-5888-44b7-b9d6-d43d351f36da None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.605882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ae84c-5888-44b7-b9d6-d43d351f36da None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.606395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ae84c-5888-44b7-b9d6-d43d351f36da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.625560 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-76d97cd3-0fd5-4e77-ac76-c2d6b115336d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.627019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-76d97cd3-0fd5-4e77-ac76-c2d6b115336d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.627141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-cd5ae84c-5888-44b7-b9d6-d43d351f36da None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.628310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cd5ae84c-5888-44b7-b9d6-d43d351f36da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.635522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 772/1560] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.636769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 789/1561] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.637535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016cba-b427-4807-80fd-84c0f683fcc9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.637880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016cba-b427-4807-80fd-84c0f683fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.638190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae016cba-b427-4807-80fd-84c0f683fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.643806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7481cc-6e18-4e57-8abf-9e34c5dc3e3a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.644228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7481cc-6e18-4e57-8abf-9e34c5dc3e3a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.644777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7481cc-6e18-4e57-8abf-9e34c5dc3e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.658480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ae016cba-b427-4807-80fd-84c0f683fcc9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.673227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ae016cba-b427-4807-80fd-84c0f683fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.673362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5e7481cc-6e18-4e57-8abf-9e34c5dc3e3a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.673362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5e7481cc-6e18-4e57-8abf-9e34c5dc3e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.673597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 773/1562] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.673597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016cba-b427-4807-80fd-84c0f683fcc9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.674735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 790/1563] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.676314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c552-8011-4e66-a558-ca00e6a5564e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.676672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c552-8011-4e66-a558-ca00e6a5564e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.677012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c552-8011-4e66-a558-ca00e6a5564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.679791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae016cba-b427-4807-80fd-84c0f683fcc9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.685065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afe5a0-ff27-4d53-ac10-4168267e4df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.685823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe5a0-ff27-4d53-ac10-4168267e4df2 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.686130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe5a0-ff27-4d53-ac10-4168267e4df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.686429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afe5a0-ff27-4d53-ac10-4168267e4df2 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.687060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afe5a0-ff27-4d53-ac10-4168267e4df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.688096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-89afe5a0-ff27-4d53-ac10-4168267e4df2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:02:41.688096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: warnings.warn(msg) Aug 24 08:02:41.688096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: Aug 24 08:02:41.689306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afe5a0-ff27-4d53-ac10-4168267e4df2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.696759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-efa9c552-8011-4e66-a558-ca00e6a5564e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.697981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-efa9c552-8011-4e66-a558-ca00e6a5564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.706737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 791/1564] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.709565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9c552-8011-4e66-a558-ca00e6a5564e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.719078 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9c552-8011-4e66-a558-ca00e6a5564e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.725196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c65b-1f57-48b3-aa2d-881cb7e808a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.726430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c65b-1f57-48b3-aa2d-881cb7e808a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.726826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c65b-1f57-48b3-aa2d-881cb7e808a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.727336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c65b-1f57-48b3-aa2d-881cb7e808a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.728451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4c65b-1f57-48b3-aa2d-881cb7e808a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.732571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4c65b-1f57-48b3-aa2d-881cb7e808a3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.811029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 774/1565] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:41.814397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546561a-ad97-4af7-bb64-78f6dfc0f95e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.814397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546561a-ad97-4af7-bb64-78f6dfc0f95e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.814397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546561a-ad97-4af7-bb64-78f6dfc0f95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.836288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f546561a-ad97-4af7-bb64-78f6dfc0f95e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.836288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f546561a-ad97-4af7-bb64-78f6dfc0f95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.849198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 775/1566] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.849198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f8740-9c49-4e08-a860-05d4e8fe6b1d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.849198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f8740-9c49-4e08-a860-05d4e8fe6b1d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.849198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f8740-9c49-4e08-a860-05d4e8fe6b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.868476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-019f8740-9c49-4e08-a860-05d4e8fe6b1d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:41.880186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 792/1567] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:41.880186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c65b-1f57-48b3-aa2d-881cb7e808a3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.880547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-019f8740-9c49-4e08-a860-05d4e8fe6b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.935708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c65b-1f57-48b3-aa2d-881cb7e808a3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.940337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a59411-fd49-459e-a6ec-352e191e0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.940938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a59411-fd49-459e-a6ec-352e191e0b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.941070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 776/1568] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:41.945109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a59411-fd49-459e-a6ec-352e191e0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.945109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a59411-fd49-459e-a6ec-352e191e0b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.948290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f8740-9c49-4e08-a860-05d4e8fe6b1d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.948435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a59411-fd49-459e-a6ec-352e191e0b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:02:41.948435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a59411-fd49-459e-a6ec-352e191e0b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.948435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a59411-fd49-459e-a6ec-352e191e0b4e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.952768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f8740-9c49-4e08-a860-05d4e8fe6b1d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.956348 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 793/1569] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:02:41.957196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a59411-fd49-459e-a6ec-352e191e0b4e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.962274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.962880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.963367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.963494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.964064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:02:41.964367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.966140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:02:41.966140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: warnings.warn(msg) Aug 24 08:02:41.966140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: Aug 24 08:02:41.967023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.974727 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a59411-fd49-459e-a6ec-352e191e0b4e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.979133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 777/1570] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:02:41.980045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:41.982215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc4ad9-859a-42f3-aed9-f5a83b1a6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.982839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4ad9-859a-42f3-aed9-f5a83b1a6de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.987037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4ad9-859a-42f3-aed9-f5a83b1a6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.987037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4ad9-859a-42f3-aed9-f5a83b1a6de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.987037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc4ad9-859a-42f3-aed9-f5a83b1a6de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:02:41.987037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc4ad9-859a-42f3-aed9-f5a83b1a6de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.987037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc4ad9-859a-42f3-aed9-f5a83b1a6de9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.999114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14610c26-10bc-4ed5-8aa1-2eeec9fd7bfb admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.000561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 794/1571] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:02:42.001388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc4ad9-859a-42f3-aed9-f5a83b1a6de9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.005738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5679b8b-3127-409b-9fe6-7d7a87bfe58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.006468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5679b8b-3127-409b-9fe6-7d7a87bfe58d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.006849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5679b8b-3127-409b-9fe6-7d7a87bfe58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.007220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5679b8b-3127-409b-9fe6-7d7a87bfe58d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.009593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5679b8b-3127-409b-9fe6-7d7a87bfe58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.010676 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5679b8b-3127-409b-9fe6-7d7a87bfe58d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.013718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc4ad9-859a-42f3-aed9-f5a83b1a6de9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.019056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7ffca-586e-4388-9cc3-328ed25e4c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.019663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ffca-586e-4388-9cc3-328ed25e4c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.019942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ffca-586e-4388-9cc3-328ed25e4c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.020245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ffca-586e-4388-9cc3-328ed25e4c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.020892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7ffca-586e-4388-9cc3-328ed25e4c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:02:42.021320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7ffca-586e-4388-9cc3-328ed25e4c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.022955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7ffca-586e-4388-9cc3-328ed25e4c59 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.027401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 778/1572] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:42.027401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5679b8b-3127-409b-9fe6-7d7a87bfe58d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.036936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5679b8b-3127-409b-9fe6-7d7a87bfe58d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.047669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 795/1573] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:02:42.047669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7ffca-586e-4388-9cc3-328ed25e4c59 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.050480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86bbb8-c871-4150-b560-0952953f8f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.050480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86bbb8-c871-4150-b560-0952953f8f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.051450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86bbb8-c871-4150-b560-0952953f8f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.051450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86bbb8-c871-4150-b560-0952953f8f0e admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.052291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86bbb8-c871-4150-b560-0952953f8f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.054996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86bbb8-c871-4150-b560-0952953f8f0e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.059350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7ffca-586e-4388-9cc3-328ed25e4c59 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.069074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c15c-b1b1-43ea-be96-c1d13dd0ecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.070011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c15c-b1b1-43ea-be96-c1d13dd0ecb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.070229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c15c-b1b1-43ea-be96-c1d13dd0ecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.072306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4c15c-b1b1-43ea-be96-c1d13dd0ecb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.072999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c15c-b1b1-43ea-be96-c1d13dd0ecb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:02:42.073308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c15c-b1b1-43ea-be96-c1d13dd0ecb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.075580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4c15c-b1b1-43ea-be96-c1d13dd0ecb8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.101595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 796/1574] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:02:42.101595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c15c-b1b1-43ea-be96-c1d13dd0ecb8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.119314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 779/1575] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:42.123517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86bbb8-c871-4150-b560-0952953f8f0e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.124863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4c15c-b1b1-43ea-be96-c1d13dd0ecb8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.129655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e3d2-f7af-4922-945c-85716cf21ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.130834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e3d2-f7af-4922-945c-85716cf21ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.131122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e3d2-f7af-4922-945c-85716cf21ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.131382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91e3d2-f7af-4922-945c-85716cf21ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.132036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91e3d2-f7af-4922-945c-85716cf21ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.134308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91e3d2-f7af-4922-945c-85716cf21ba5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.136706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86bbb8-c871-4150-b560-0952953f8f0e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.141806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c1823-46bb-4338-b3bb-a0cc4994532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.142441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c1823-46bb-4338-b3bb-a0cc4994532e admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.142722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c1823-46bb-4338-b3bb-a0cc4994532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.142995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c1823-46bb-4338-b3bb-a0cc4994532e admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.143625 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c1823-46bb-4338-b3bb-a0cc4994532e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.145637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c1823-46bb-4338-b3bb-a0cc4994532e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.150190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:42.199944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 797/1576] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:42.201126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e3d2-f7af-4922-945c-85716cf21ba5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.218205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 780/1577] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:42.219582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c1823-46bb-4338-b3bb-a0cc4994532e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.235854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:42.276950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91e3d2-f7af-4922-945c-85716cf21ba5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.289607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c1823-46bb-4338-b3bb-a0cc4994532e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.294906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecbfe7-7f0e-4146-85bd-fea96bda3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.296011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecbfe7-7f0e-4146-85bd-fea96bda3e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.296295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecbfe7-7f0e-4146-85bd-fea96bda3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.296569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecbfe7-7f0e-4146-85bd-fea96bda3e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.297216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecbfe7-7f0e-4146-85bd-fea96bda3e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.299141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecbfe7-7f0e-4146-85bd-fea96bda3e87 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.314744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 781/1578] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:42.314744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecbfe7-7f0e-4146-85bd-fea96bda3e87 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.326797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecbfe7-7f0e-4146-85bd-fea96bda3e87 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.332148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374efc32-1739-4fe3-a943-06ad526281e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.332755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374efc32-1739-4fe3-a943-06ad526281e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.333028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374efc32-1739-4fe3-a943-06ad526281e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.333297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374efc32-1739-4fe3-a943-06ad526281e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.333980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374efc32-1739-4fe3-a943-06ad526281e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.336643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374efc32-1739-4fe3-a943-06ad526281e6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.348461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175bb6-fada-4fc3-a9a8-3eb0db06eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.349156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175bb6-fada-4fc3-a9a8-3eb0db06eaab admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.349431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175bb6-fada-4fc3-a9a8-3eb0db06eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.349740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175bb6-fada-4fc3-a9a8-3eb0db06eaab admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.350442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175bb6-fada-4fc3-a9a8-3eb0db06eaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.352425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175bb6-fada-4fc3-a9a8-3eb0db06eaab admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.446006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 782/1579] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:42.446567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374efc32-1739-4fe3-a943-06ad526281e6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.508449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 798/1580] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/projects => generated 367 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:42.510094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175bb6-fada-4fc3-a9a8-3eb0db06eaab admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.512429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374efc32-1739-4fe3-a943-06ad526281e6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.571363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6e01-f58b-4480-b365-b89a2eeed940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.571991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6e01-f58b-4480-b365-b89a2eeed940 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.572250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6e01-f58b-4480-b365-b89a2eeed940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.572520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6e01-f58b-4480-b365-b89a2eeed940 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.572671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175bb6-fada-4fc3-a9a8-3eb0db06eaab admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.573164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd6e01-f58b-4480-b365-b89a2eeed940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.575161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd6e01-f58b-4480-b365-b89a2eeed940 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.577270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b8e5a-b1a9-427e-8640-963da5681f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.577969 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b8e5a-b1a9-427e-8640-963da5681f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.578244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b8e5a-b1a9-427e-8640-963da5681f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.578576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b8e5a-b1a9-427e-8640-963da5681f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.579233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b8e5a-b1a9-427e-8640-963da5681f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.580816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b8e5a-b1a9-427e-8640-963da5681f67 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.591149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 799/1581] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:42.594927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b8e5a-b1a9-427e-8640-963da5681f67 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.604590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b8e5a-b1a9-427e-8640-963da5681f67 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.610141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5745b7c-477a-44f6-95b4-1592c747ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.610738 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5745b7c-477a-44f6-95b4-1592c747ea67 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.611012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5745b7c-477a-44f6-95b4-1592c747ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.611279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5745b7c-477a-44f6-95b4-1592c747ea67 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.611899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5745b7c-477a-44f6-95b4-1592c747ea67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.613915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5745b7c-477a-44f6-95b4-1592c747ea67 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.656597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 783/1582] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/projects => generated 363 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:42.657538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6e01-f58b-4480-b365-b89a2eeed940 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.679869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:42.730894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 800/1583] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:42.733165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6e01-f58b-4480-b365-b89a2eeed940 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.733289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5745b7c-477a-44f6-95b4-1592c747ea67 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.738154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc8274-4e8b-4f0e-9061-63abcbfb8541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.739267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc8274-4e8b-4f0e-9061-63abcbfb8541 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.740898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc8274-4e8b-4f0e-9061-63abcbfb8541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.741732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc8274-4e8b-4f0e-9061-63abcbfb8541 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.742520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc8274-4e8b-4f0e-9061-63abcbfb8541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.743617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5745b7c-477a-44f6-95b4-1592c747ea67 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.745108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc8274-4e8b-4f0e-9061-63abcbfb8541 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.749333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdf4b3-109a-461c-a8d8-ad1adfcf54b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.749635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdf4b3-109a-461c-a8d8-ad1adfcf54b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.749907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdf4b3-109a-461c-a8d8-ad1adfcf54b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.750212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdf4b3-109a-461c-a8d8-ad1adfcf54b8 admin admin] PATH_INFO: `/v3/projects/abe1334c35f34c06a5a97d5daee3c995/users/af1baafb29de4485b4712a29fdfaf9ed/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.754360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:42.768789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdf4b3-109a-461c-a8d8-ad1adfcf54b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe1334c35f34c06a5a97d5daee3c995, user_id=af1baafb29de4485b4712a29fdfaf9ed, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.769599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-7dbdf4b3-109a-461c-a8d8-ad1adfcf54b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:02:42.769599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: warnings.warn(msg) Aug 24 08:02:42.769599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: Aug 24 08:02:42.771539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdf4b3-109a-461c-a8d8-ad1adfcf54b8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.866527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 784/1585] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:42.866527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc8274-4e8b-4f0e-9061-63abcbfb8541 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.867125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 801/1585] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:42 2022] PUT /identity/v3/projects/abe1334c35f34c06a5a97d5daee3c995/users/af1baafb29de4485b4712a29fdfaf9ed/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:42.868051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdf4b3-109a-461c-a8d8-ad1adfcf54b8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:42.877559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc8274-4e8b-4f0e-9061-63abcbfb8541 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.943035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdf4b3-109a-461c-a8d8-ad1adfcf54b8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:42.959567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacbdd-0dc1-4449-8121-63a0776ac27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.959567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacbdd-0dc1-4449-8121-63a0776ac27b admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.959567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacbdd-0dc1-4449-8121-63a0776ac27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.959567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacbdd-0dc1-4449-8121-63a0776ac27b admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.960168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aacbdd-0dc1-4449-8121-63a0776ac27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.960168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aacbdd-0dc1-4449-8121-63a0776ac27b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:42.971398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbaee6-2f78-4fdd-b845-9a19e3e886e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:42.972225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbaee6-2f78-4fdd-b845-9a19e3e886e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:42.972522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbaee6-2f78-4fdd-b845-9a19e3e886e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:42.972791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbaee6-2f78-4fdd-b845-9a19e3e886e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:42.973567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbaee6-2f78-4fdd-b845-9a19e3e886e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:42.976635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbaee6-2f78-4fdd-b845-9a19e3e886e2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.101189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 802/1586] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:43.104483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacbdd-0dc1-4449-8121-63a0776ac27b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.105184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 785/1587] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:42 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:43.106852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbaee6-2f78-4fdd-b845-9a19e3e886e2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.117103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbaee6-2f78-4fdd-b845-9a19e3e886e2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.118428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacbdd-0dc1-4449-8121-63a0776ac27b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.122972 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e53a4-45c3-484d-9c4b-4e49848a66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.123123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c58afc-9410-4a11-8f1c-f9ab5c34c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.123585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e53a4-45c3-484d-9c4b-4e49848a66f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.123709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c58afc-9410-4a11-8f1c-f9ab5c34c5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.123891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c58afc-9410-4a11-8f1c-f9ab5c34c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.124027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e53a4-45c3-484d-9c4b-4e49848a66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.124216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e53a4-45c3-484d-9c4b-4e49848a66f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.124330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c58afc-9410-4a11-8f1c-f9ab5c34c5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.124831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e53a4-45c3-484d-9c4b-4e49848a66f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.124966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c58afc-9410-4a11-8f1c-f9ab5c34c5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.126517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c58afc-9410-4a11-8f1c-f9ab5c34c5e9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.126821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e53a4-45c3-484d-9c4b-4e49848a66f3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.139467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 803/1588] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.140089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c58afc-9410-4a11-8f1c-f9ab5c34c5e9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.150669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c58afc-9410-4a11-8f1c-f9ab5c34c5e9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.155482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92942cd-cf6c-47b4-8dc2-6e86bec0e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.156084 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92942cd-cf6c-47b4-8dc2-6e86bec0e2df admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.156419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92942cd-cf6c-47b4-8dc2-6e86bec0e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.156682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92942cd-cf6c-47b4-8dc2-6e86bec0e2df admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.157282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92942cd-cf6c-47b4-8dc2-6e86bec0e2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.158916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92942cd-cf6c-47b4-8dc2-6e86bec0e2df admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.171536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 804/1589] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.176316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92942cd-cf6c-47b4-8dc2-6e86bec0e2df admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.182395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92942cd-cf6c-47b4-8dc2-6e86bec0e2df admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.188053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fcf74-dd08-4337-89fb-1de0fd56b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.188524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fcf74-dd08-4337-89fb-1de0fd56b908 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.188842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fcf74-dd08-4337-89fb-1de0fd56b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.189065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fcf74-dd08-4337-89fb-1de0fd56b908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.189735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fcf74-dd08-4337-89fb-1de0fd56b908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.191332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fcf74-dd08-4337-89fb-1de0fd56b908 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.195330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 786/1590] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:43 2022] POST /identity/v3/users => generated 282 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:43.195330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bedf47-c61e-438f-9872-fe8a43f5c4c6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.202057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bedf47-c61e-438f-9872-fe8a43f5c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.202057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bedf47-c61e-438f-9872-fe8a43f5c4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.203126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 805/1591] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.203988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fcf74-dd08-4337-89fb-1de0fd56b908 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.214332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fcf74-dd08-4337-89fb-1de0fd56b908 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.220224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08014d45-ef15-4dca-b5ac-b60707eeda3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.220428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014d45-ef15-4dca-b5ac-b60707eeda3d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.220667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014d45-ef15-4dca-b5ac-b60707eeda3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.220940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014d45-ef15-4dca-b5ac-b60707eeda3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.221623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08014d45-ef15-4dca-b5ac-b60707eeda3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.223879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08014d45-ef15-4dca-b5ac-b60707eeda3d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.238566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 806/1592] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.238566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08014d45-ef15-4dca-b5ac-b60707eeda3d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.241399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-26bedf47-c61e-438f-9872-fe8a43f5c4c6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:43.242963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-26bedf47-c61e-438f-9872-fe8a43f5c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:43.247866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08014d45-ef15-4dca-b5ac-b60707eeda3d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.253367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1928-f1ec-4b9a-902c-f7e4f214a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.254071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1928-f1ec-4b9a-902c-f7e4f214a80d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.254424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1928-f1ec-4b9a-902c-f7e4f214a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.255013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1928-f1ec-4b9a-902c-f7e4f214a80d admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.255765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1928-f1ec-4b9a-902c-f7e4f214a80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.258709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 787/1593] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:43.261962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bedf47-c61e-438f-9872-fe8a43f5c4c6 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.262090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1928-f1ec-4b9a-902c-f7e4f214a80d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.272851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bedf47-c61e-438f-9872-fe8a43f5c4c6 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.277061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 807/1594] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.277061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1928-f1ec-4b9a-902c-f7e4f214a80d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.278470 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588938f0-9295-4614-b67f-2223978a7241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.280573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588938f0-9295-4614-b67f-2223978a7241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.280923 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588938f0-9295-4614-b67f-2223978a7241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.281752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588938f0-9295-4614-b67f-2223978a7241 admin admin] PATH_INFO: `/v3/projects/d3a415b7d49c400f8baa62e3f73d8f3a/users/53cbeea9dfac4cab928fbaefcef7e696/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.286660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1928-f1ec-4b9a-902c-f7e4f214a80d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.291800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a9d01-1157-4b0f-87ba-baf0d75cef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.292491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a9d01-1157-4b0f-87ba-baf0d75cef2c admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.292846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a9d01-1157-4b0f-87ba-baf0d75cef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.294140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a9d01-1157-4b0f-87ba-baf0d75cef2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.295114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a9d01-1157-4b0f-87ba-baf0d75cef2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.297211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a9d01-1157-4b0f-87ba-baf0d75cef2c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.301379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588938f0-9295-4614-b67f-2223978a7241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a415b7d49c400f8baa62e3f73d8f3a, user_id=53cbeea9dfac4cab928fbaefcef7e696, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.306277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588938f0-9295-4614-b67f-2223978a7241 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.314759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 808/1595] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.314759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a9d01-1157-4b0f-87ba-baf0d75cef2c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.324588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a9d01-1157-4b0f-87ba-baf0d75cef2c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.329722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcda9e-bcf2-4804-9f7d-30b81497a12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.330479 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcda9e-bcf2-4804-9f7d-30b81497a12e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.336398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcda9e-bcf2-4804-9f7d-30b81497a12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.336398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcda9e-bcf2-4804-9f7d-30b81497a12e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.336398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcda9e-bcf2-4804-9f7d-30b81497a12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.336398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcda9e-bcf2-4804-9f7d-30b81497a12e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.345181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 809/1596] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.345898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcda9e-bcf2-4804-9f7d-30b81497a12e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.365790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcda9e-bcf2-4804-9f7d-30b81497a12e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.365790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c64e5-f7ef-4525-b670-849edf92c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.365790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c64e5-f7ef-4525-b670-849edf92c52d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.365790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c64e5-f7ef-4525-b670-849edf92c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.366240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c64e5-f7ef-4525-b670-849edf92c52d admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.366560 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c64e5-f7ef-4525-b670-849edf92c52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.370365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c64e5-f7ef-4525-b670-849edf92c52d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.385674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 810/1597] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.387024 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c64e5-f7ef-4525-b670-849edf92c52d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.398848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 788/1598] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:43 2022] PUT /identity/v3/projects/d3a415b7d49c400f8baa62e3f73d8f3a/users/53cbeea9dfac4cab928fbaefcef7e696/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:43.398848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588938f0-9295-4614-b67f-2223978a7241 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.399064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c64e5-f7ef-4525-b670-849edf92c52d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.462108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:43.474563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:43.478985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588938f0-9295-4614-b67f-2223978a7241 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.479375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3239caf-4d59-4a42-bc49-36498ff4b126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.480101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3239caf-4d59-4a42-bc49-36498ff4b126 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.481579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3239caf-4d59-4a42-bc49-36498ff4b126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.481929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3239caf-4d59-4a42-bc49-36498ff4b126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.482668 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3239caf-4d59-4a42-bc49-36498ff4b126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.484342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3239caf-4d59-4a42-bc49-36498ff4b126 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.484603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd5cfe-47ef-419e-bcf9-ca7ccc07dd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.485242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd5cfe-47ef-419e-bcf9-ca7ccc07dd91 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.485738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd5cfe-47ef-419e-bcf9-ca7ccc07dd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.486014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd5cfe-47ef-419e-bcf9-ca7ccc07dd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.500838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd5cfe-47ef-419e-bcf9-ca7ccc07dd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.502450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd5cfe-47ef-419e-bcf9-ca7ccc07dd91 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.510205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 811/1599] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.512628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3239caf-4d59-4a42-bc49-36498ff4b126 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.517532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 789/1600] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:43.525826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3239caf-4d59-4a42-bc49-36498ff4b126 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.529134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd5cfe-47ef-419e-bcf9-ca7ccc07dd91 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.531591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38815e63-d0f4-4744-b275-ebb1ec432d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.532432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38815e63-d0f4-4744-b275-ebb1ec432d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.533075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38815e63-d0f4-4744-b275-ebb1ec432d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.533582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38815e63-d0f4-4744-b275-ebb1ec432d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.534868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38815e63-d0f4-4744-b275-ebb1ec432d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.536806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38815e63-d0f4-4744-b275-ebb1ec432d11 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.550734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 812/1601] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.552163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38815e63-d0f4-4744-b275-ebb1ec432d11 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.566924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd5cfe-47ef-419e-bcf9-ca7ccc07dd91 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.571872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38815e63-d0f4-4744-b275-ebb1ec432d11 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.577079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd898b5-7d99-4c73-a86d-d04f9e92c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.577752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd898b5-7d99-4c73-a86d-d04f9e92c7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.578028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd898b5-7d99-4c73-a86d-d04f9e92c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.578299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd898b5-7d99-4c73-a86d-d04f9e92c7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.578538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f8fbb-5f78-49b0-8e4b-9a246dc704e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.579049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd898b5-7d99-4c73-a86d-d04f9e92c7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.579425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f8fbb-5f78-49b0-8e4b-9a246dc704e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.579769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f8fbb-5f78-49b0-8e4b-9a246dc704e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.580107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f8fbb-5f78-49b0-8e4b-9a246dc704e6 admin admin] PATH_INFO: `/v3/projects/14b8c522fdf14a9fb1514148392598c5/users/9870363844644da7ad0a353f8ebfeffc/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.580630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd898b5-7d99-4c73-a86d-d04f9e92c7e7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.595736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 813/1602] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:43.595736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd898b5-7d99-4c73-a86d-d04f9e92c7e7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.606294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd898b5-7d99-4c73-a86d-d04f9e92c7e7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.606452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f8fbb-5f78-49b0-8e4b-9a246dc704e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b8c522fdf14a9fb1514148392598c5, user_id=9870363844644da7ad0a353f8ebfeffc, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.609533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b16402-6cd3-4813-b0ec-d6dbfcd41615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.609881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f8fbb-5f78-49b0-8e4b-9a246dc704e6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.610355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b16402-6cd3-4813-b0ec-d6dbfcd41615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.610635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b16402-6cd3-4813-b0ec-d6dbfcd41615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.610909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b16402-6cd3-4813-b0ec-d6dbfcd41615 admin admin] PATH_INFO: `/v3/projects/98c96fa0cc84461dbc7ba9e310db982c/users/7fd652ca8c6845fca2da1fe2ae125f1f/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.633211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b16402-6cd3-4813-b0ec-d6dbfcd41615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c96fa0cc84461dbc7ba9e310db982c, user_id=7fd652ca8c6845fca2da1fe2ae125f1f, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.633211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b16402-6cd3-4813-b0ec-d6dbfcd41615 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.704906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 790/1603] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:43 2022] PUT /identity/v3/projects/14b8c522fdf14a9fb1514148392598c5/users/9870363844644da7ad0a353f8ebfeffc/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:43.706950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdced2b-738f-4a3b-820a-3412e286cb43 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.707503 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdced2b-738f-4a3b-820a-3412e286cb43 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.708052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdced2b-738f-4a3b-820a-3412e286cb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.745660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 814/1604] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:43 2022] PUT /identity/v3/projects/98c96fa0cc84461dbc7ba9e310db982c/users/7fd652ca8c6845fca2da1fe2ae125f1f/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:43.745660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b16402-6cd3-4813-b0ec-d6dbfcd41615 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.868552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5fdced2b-738f-4a3b-820a-3412e286cb43 None None] MFA Rules not processed for user `53cbeea9dfac4cab928fbaefcef7e696`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:43.868552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5fdced2b-738f-4a3b-820a-3412e286cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:43.885124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b16402-6cd3-4813-b0ec-d6dbfcd41615 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.894000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bfd02-5eff-4091-b717-98adf0313a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.894739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bfd02-5eff-4091-b717-98adf0313a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.895017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bfd02-5eff-4091-b717-98adf0313a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.895292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bfd02-5eff-4091-b717-98adf0313a6a admin admin] PATH_INFO: `/v3/projects/ec69c9250f484de0b2ce29e6f4c322c0/users/37add1c9f3774ab0bbb0ff5cb0ed1bd9/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.917064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bfd02-5eff-4091-b717-98adf0313a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec69c9250f484de0b2ce29e6f4c322c0, user_id=37add1c9f3774ab0bbb0ff5cb0ed1bd9, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:43.922414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bfd02-5eff-4091-b717-98adf0313a6a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:43.959467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 791/1605] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:43.960344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdced2b-738f-4a3b-820a-3412e286cb43 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.975348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdced2b-738f-4a3b-820a-3412e286cb43 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.981048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc2ea3-9d7a-4039-a095-6a14eafe5f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.981843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc2ea3-9d7a-4039-a095-6a14eafe5f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.982240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc2ea3-9d7a-4039-a095-6a14eafe5f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.982954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc2ea3-9d7a-4039-a095-6a14eafe5f61 admin admin] PATH_INFO: `/v3/projects/013d6e97b2f54fdcb43e6a5ed6fb4a51/users/145c02717fc04c4aa81829de41470262/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.992199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 815/1606] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:43 2022] PUT /identity/v3/projects/ec69c9250f484de0b2ce29e6f4c322c0/users/37add1c9f3774ab0bbb0ff5cb0ed1bd9/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:43.993089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bfd02-5eff-4091-b717-98adf0313a6a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:44.000186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc2ea3-9d7a-4039-a095-6a14eafe5f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013d6e97b2f54fdcb43e6a5ed6fb4a51, user_id=145c02717fc04c4aa81829de41470262, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:44.002497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc2ea3-9d7a-4039-a095-6a14eafe5f61 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:44.080943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bfd02-5eff-4091-b717-98adf0313a6a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:44.086232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb6e6b-a425-4628-a69b-0306246db6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:44.086996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb6e6b-a425-4628-a69b-0306246db6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.087949 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb6e6b-a425-4628-a69b-0306246db6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.088228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb6e6b-a425-4628-a69b-0306246db6aa admin admin] PATH_INFO: `/v3/projects/1bfc8c6c9c9e4d29ab16eb05fd5912bc/users/2aaa1f36928547248ab3eb98c68226be/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.103037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 792/1607] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:43 2022] PUT /identity/v3/projects/013d6e97b2f54fdcb43e6a5ed6fb4a51/users/145c02717fc04c4aa81829de41470262/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:44.104021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858914c-bb45-4a6c-a97f-0ce95e90823e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.104303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858914c-bb45-4a6c-a97f-0ce95e90823e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.104573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858914c-bb45-4a6c-a97f-0ce95e90823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.114191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb6e6b-a425-4628-a69b-0306246db6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfc8c6c9c9e4d29ab16eb05fd5912bc, user_id=2aaa1f36928547248ab3eb98c68226be, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:44.117301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb6e6b-a425-4628-a69b-0306246db6aa admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:44.126854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c858914c-bb45-4a6c-a97f-0ce95e90823e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:44.128076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c858914c-bb45-4a6c-a97f-0ce95e90823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:44.188418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:44.195965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 816/1608] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:43 2022] PUT /identity/v3/projects/1bfc8c6c9c9e4d29ab16eb05fd5912bc/users/2aaa1f36928547248ab3eb98c68226be/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:44.204378 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd9b8f-607a-4a6a-9206-64ac8c702b83 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.204750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd9b8f-607a-4a6a-9206-64ac8c702b83 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.205334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd9b8f-607a-4a6a-9206-64ac8c702b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.235049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 793/1609] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:44.238012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858914c-bb45-4a6c-a97f-0ce95e90823e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:44.250263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d8dd9b8f-607a-4a6a-9206-64ac8c702b83 None None] MFA Rules not processed for user `7fd652ca8c6845fca2da1fe2ae125f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:44.254264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d8dd9b8f-607a-4a6a-9206-64ac8c702b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:44.264635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858914c-bb45-4a6c-a97f-0ce95e90823e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:44.311035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:44.367856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 817/1610] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:44.370242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae9f95-1c5c-4ead-8ba3-228505d55083 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.370708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae9f95-1c5c-4ead-8ba3-228505d55083 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.371797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae9f95-1c5c-4ead-8ba3-228505d55083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.386082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1434a-4048-4bb1-882f-b962c10cce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:44.386965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1434a-4048-4bb1-882f-b962c10cce17 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.387902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1434a-4048-4bb1-882f-b962c10cce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.388095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1434a-4048-4bb1-882f-b962c10cce17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.396331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1434a-4048-4bb1-882f-b962c10cce17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:44.400404 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1434a-4048-4bb1-882f-b962c10cce17 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:44.430849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d8ae9f95-1c5c-4ead-8ba3-228505d55083 None None] MFA Rules not processed for user `37add1c9f3774ab0bbb0ff5cb0ed1bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:44.432012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d8ae9f95-1c5c-4ead-8ba3-228505d55083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:44.538020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 794/1611] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/projects => generated 377 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:44.538020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd0e53-7e21-4e30-aa64-402ddce8e018 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.538020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd0e53-7e21-4e30-aa64-402ddce8e018 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.538020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd0e53-7e21-4e30-aa64-402ddce8e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.553917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 818/1612] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:44.556021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2fc15-1e56-44e3-b8e2-b25220409a5e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.556319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2fc15-1e56-44e3-b8e2-b25220409a5e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.556587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2fc15-1e56-44e3-b8e2-b25220409a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.586110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cdcd0e53-7e21-4e30-aa64-402ddce8e018 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:44.587368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cdcd0e53-7e21-4e30-aa64-402ddce8e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:44.609343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8cf2fc15-1e56-44e3-b8e2-b25220409a5e None None] MFA Rules not processed for user `2aaa1f36928547248ab3eb98c68226be`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:44.610831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8cf2fc15-1e56-44e3-b8e2-b25220409a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:44.679244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 795/1613] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:44.680218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd0e53-7e21-4e30-aa64-402ddce8e018 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:44.739875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 819/1614] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:44.741652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ceb43-221a-49f6-ab68-378ff38b33b3 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.742175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ceb43-221a-49f6-ab68-378ff38b33b3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.742661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ceb43-221a-49f6-ab68-378ff38b33b3 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.744613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 820/1615] 10.222.0.58 () {54 vars in 962 bytes} [Wed Aug 24 08:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:44.745577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ceb43-221a-49f6-ab68-378ff38b33b3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:44.767509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd0e53-7e21-4e30-aa64-402ddce8e018 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:44.768045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ceb43-221a-49f6-ab68-378ff38b33b3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:44.771694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74a20-170a-4321-b64f-341b543bab3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:44.772929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e98e5-e1a2-4f7f-959f-1d2ab0e01947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:44.773497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e98e5-e1a2-4f7f-959f-1d2ab0e01947 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.773739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74a20-170a-4321-b64f-341b543bab3f service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.773866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e98e5-e1a2-4f7f-959f-1d2ab0e01947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.774059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e98e5-e1a2-4f7f-959f-1d2ab0e01947 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.774468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74a20-170a-4321-b64f-341b543bab3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.774698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e98e5-e1a2-4f7f-959f-1d2ab0e01947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:44.775640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74a20-170a-4321-b64f-341b543bab3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.776647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e98e5-e1a2-4f7f-959f-1d2ab0e01947 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:44.788313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:44.793922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74a20-170a-4321-b64f-341b543bab3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:44.795455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74a20-170a-4321-b64f-341b543bab3f service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:44.805766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 796/1616] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:44.806968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74a20-170a-4321-b64f-341b543bab3f service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:44.816530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74a20-170a-4321-b64f-341b543bab3f service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:44.820939 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538435a-fd1a-4131-8b86-77a28a1ec6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:44.821572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538435a-fd1a-4131-8b86-77a28a1ec6cb admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.821846 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538435a-fd1a-4131-8b86-77a28a1ec6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.822113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538435a-fd1a-4131-8b86-77a28a1ec6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.822726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538435a-fd1a-4131-8b86-77a28a1ec6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:44.829499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538435a-fd1a-4131-8b86-77a28a1ec6cb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:44.864380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 821/1617] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:44.869327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e98e5-e1a2-4f7f-959f-1d2ab0e01947 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:44.880585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e98e5-e1a2-4f7f-959f-1d2ab0e01947 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:44.884344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91f54-74a7-4bf1-a7cf-ace198a3bb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:44.884942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91f54-74a7-4bf1-a7cf-ace198a3bb5a service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.885220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91f54-74a7-4bf1-a7cf-ace198a3bb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.885533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91f54-74a7-4bf1-a7cf-ace198a3bb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.895814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b91f54-74a7-4bf1-a7cf-ace198a3bb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:44.897499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b91f54-74a7-4bf1-a7cf-ace198a3bb5a service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:44.908173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 822/1618] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:44.909439 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91f54-74a7-4bf1-a7cf-ace198a3bb5a service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:44.932535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91f54-74a7-4bf1-a7cf-ace198a3bb5a service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:44.945872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 797/1619] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:44.948070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d13db-09d0-45ba-a80f-cbce3f85ffcd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.948362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d13db-09d0-45ba-a80f-cbce3f85ffcd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.948843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d13db-09d0-45ba-a80f-cbce3f85ffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.959426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959b863-9bfc-42b6-b58e-c8f6e87f8853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:44.964690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959b863-9bfc-42b6-b58e-c8f6e87f8853 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:44.964690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959b863-9bfc-42b6-b58e-c8f6e87f8853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:44.964945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959b863-9bfc-42b6-b58e-c8f6e87f8853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:44.968085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959b863-9bfc-42b6-b58e-c8f6e87f8853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:44.974105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959b863-9bfc-42b6-b58e-c8f6e87f8853 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.079327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7f3d13db-09d0-45ba-a80f-cbce3f85ffcd None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:45.081410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7f3d13db-09d0-45ba-a80f-cbce3f85ffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:45.121744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:45.157521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 823/1620] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:45.157521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959b863-9bfc-42b6-b58e-c8f6e87f8853 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.187249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 798/1621] 10.222.0.58 () {58 vars in 1059 bytes} [Wed Aug 24 08:02:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:45.188168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d13db-09d0-45ba-a80f-cbce3f85ffcd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.270303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959b863-9bfc-42b6-b58e-c8f6e87f8853 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.280039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d13db-09d0-45ba-a80f-cbce3f85ffcd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.281183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c001103-4fdd-48ae-b184-a6618673ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.282420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c001103-4fdd-48ae-b184-a6618673ba12 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.283557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c001103-4fdd-48ae-b184-a6618673ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.283864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c001103-4fdd-48ae-b184-a6618673ba12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.284507 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c001103-4fdd-48ae-b184-a6618673ba12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:45.286145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c001103-4fdd-48ae-b184-a6618673ba12 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.292139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae725c9-e9f3-4066-82b2-f43d2ea1c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.293057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae725c9-e9f3-4066-82b2-f43d2ea1c354 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.293479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae725c9-e9f3-4066-82b2-f43d2ea1c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.293768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae725c9-e9f3-4066-82b2-f43d2ea1c354 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.294897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae725c9-e9f3-4066-82b2-f43d2ea1c354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:45.296701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae725c9-e9f3-4066-82b2-f43d2ea1c354 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.312726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 824/1622] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:45.314113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c001103-4fdd-48ae-b184-a6618673ba12 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.334217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c001103-4fdd-48ae-b184-a6618673ba12 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.338907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34548d16-e32c-461b-b1f9-8d85d2125092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.339841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34548d16-e32c-461b-b1f9-8d85d2125092 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.340141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34548d16-e32c-461b-b1f9-8d85d2125092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.340400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34548d16-e32c-461b-b1f9-8d85d2125092 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.341042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34548d16-e32c-461b-b1f9-8d85d2125092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:45.343451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34548d16-e32c-461b-b1f9-8d85d2125092 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.434965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 799/1623] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:45 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:45.436582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae725c9-e9f3-4066-82b2-f43d2ea1c354 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.505979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 825/1624] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:45 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:45.506847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34548d16-e32c-461b-b1f9-8d85d2125092 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.519333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae725c9-e9f3-4066-82b2-f43d2ea1c354 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.525834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f1744-c2fd-4829-bb0b-c2d1288d630b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.529298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f1744-c2fd-4829-bb0b-c2d1288d630b service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.529298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f1744-c2fd-4829-bb0b-c2d1288d630b service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.529298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f1744-c2fd-4829-bb0b-c2d1288d630b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.529797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34548d16-e32c-461b-b1f9-8d85d2125092 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.536897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447d7a1-627d-437f-8791-3f2a4de66541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.537556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447d7a1-627d-437f-8791-3f2a4de66541 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.537840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447d7a1-627d-437f-8791-3f2a4de66541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.538114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447d7a1-627d-437f-8791-3f2a4de66541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.538775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447d7a1-627d-437f-8791-3f2a4de66541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:45.550942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447d7a1-627d-437f-8791-3f2a4de66541 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.575178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 826/1625] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:45.575178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447d7a1-627d-437f-8791-3f2a4de66541 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.594372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447d7a1-627d-437f-8791-3f2a4de66541 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.602997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e195e-7315-4545-9abd-b8fef8fa848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.605140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e195e-7315-4545-9abd-b8fef8fa848d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.606122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e195e-7315-4545-9abd-b8fef8fa848d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.606548 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e195e-7315-4545-9abd-b8fef8fa848d admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.607412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e195e-7315-4545-9abd-b8fef8fa848d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:45.611245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f1744-c2fd-4829-bb0b-c2d1288d630b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:45.613297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f1744-c2fd-4829-bb0b-c2d1288d630b service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.613448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e195e-7315-4545-9abd-b8fef8fa848d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.625855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 800/1626] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:45.626729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f1744-c2fd-4829-bb0b-c2d1288d630b service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.639696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f1744-c2fd-4829-bb0b-c2d1288d630b service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.644537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 827/1627] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:45.652042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e195e-7315-4545-9abd-b8fef8fa848d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.652413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5646b-2ac7-4007-9402-2e6163b19031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.652413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5646b-2ac7-4007-9402-2e6163b19031 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.652413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5646b-2ac7-4007-9402-2e6163b19031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.652413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5646b-2ac7-4007-9402-2e6163b19031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.652717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5646b-2ac7-4007-9402-2e6163b19031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:45.654856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5646b-2ac7-4007-9402-2e6163b19031 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.667226 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e195e-7315-4545-9abd-b8fef8fa848d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.677105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 801/1628] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:45.677105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5646b-2ac7-4007-9402-2e6163b19031 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.680588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e0b91-c688-4dc1-9980-54beb194c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.680588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e0b91-c688-4dc1-9980-54beb194c7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.680588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e0b91-c688-4dc1-9980-54beb194c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.680588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e0b91-c688-4dc1-9980-54beb194c7ff admin admin] PATH_INFO: `/v3/projects/1b603054e9b3455b91a11d98c1372d72/users/4ab18c7a32f44f26abeb2e8fa10e5b45/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.692157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5646b-2ac7-4007-9402-2e6163b19031 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.697180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e0b91-c688-4dc1-9980-54beb194c7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b603054e9b3455b91a11d98c1372d72, user_id=4ab18c7a32f44f26abeb2e8fa10e5b45, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:45.698236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4820b-7967-466c-a369-d221db0878f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.699336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4820b-7967-466c-a369-d221db0878f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.699744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4820b-7967-466c-a369-d221db0878f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.700104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4820b-7967-466c-a369-d221db0878f7 admin admin] PATH_INFO: `/v3/projects/2d8fb4784673408c91aec93472ee475d/users/d0bcd17daeca4c18b964ae2af6348df4/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.700599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e0b91-c688-4dc1-9980-54beb194c7ff admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.718764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4820b-7967-466c-a369-d221db0878f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8fb4784673408c91aec93472ee475d, user_id=d0bcd17daeca4c18b964ae2af6348df4, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:45.721662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4820b-7967-466c-a369-d221db0878f7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:45.789217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 828/1629] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:45 2022] PUT /identity/v3/projects/1b603054e9b3455b91a11d98c1372d72/users/4ab18c7a32f44f26abeb2e8fa10e5b45/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:45.789217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e0b91-c688-4dc1-9980-54beb194c7ff admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:45.801197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 802/1630] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:45 2022] PUT /identity/v3/projects/2d8fb4784673408c91aec93472ee475d/users/d0bcd17daeca4c18b964ae2af6348df4/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:45.802669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c584f-8a02-40d9-b03c-8b6251493c7a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.802949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c584f-8a02-40d9-b03c-8b6251493c7a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.803220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c584f-8a02-40d9-b03c-8b6251493c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:45.867605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1f7c584f-8a02-40d9-b03c-8b6251493c7a None None] MFA Rules not processed for user `4ab18c7a32f44f26abeb2e8fa10e5b45`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:45.868955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1f7c584f-8a02-40d9-b03c-8b6251493c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:45.872979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:45.878555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:45.899370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e0b91-c688-4dc1-9980-54beb194c7ff admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:45.988280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712548b-687b-456e-8324-b4d2104d2641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:45.988960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712548b-687b-456e-8324-b4d2104d2641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:45.989240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712548b-687b-456e-8324-b4d2104d2641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:45.989561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712548b-687b-456e-8324-b4d2104d2641 admin admin] PATH_INFO: `/v3/projects/145005f5805d45e99b83674e9380c7d1/users/ecced4553f2e4734bf127028391c8028/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.010080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712548b-687b-456e-8324-b4d2104d2641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145005f5805d45e99b83674e9380c7d1, user_id=ecced4553f2e4734bf127028391c8028, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:46.014976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712548b-687b-456e-8324-b4d2104d2641 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:46.032607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 803/1631] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:46.032607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c584f-8a02-40d9-b03c-8b6251493c7a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:46.044900 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c584f-8a02-40d9-b03c-8b6251493c7a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:46.051982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214ef37-8e45-4dae-9582-3eebf6a00322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:46.052753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214ef37-8e45-4dae-9582-3eebf6a00322 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.053648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214ef37-8e45-4dae-9582-3eebf6a00322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.054111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214ef37-8e45-4dae-9582-3eebf6a00322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.055166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214ef37-8e45-4dae-9582-3eebf6a00322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:46.057964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214ef37-8e45-4dae-9582-3eebf6a00322 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:46.073714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 804/1632] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:46.079897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214ef37-8e45-4dae-9582-3eebf6a00322 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:46.103583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214ef37-8e45-4dae-9582-3eebf6a00322 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:46.103583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc52a6d-42f0-4f86-9b3b-c54ab81e4869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:46.103583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc52a6d-42f0-4f86-9b3b-c54ab81e4869 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.103583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc52a6d-42f0-4f86-9b3b-c54ab81e4869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.104050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc52a6d-42f0-4f86-9b3b-c54ab81e4869 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.104050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc52a6d-42f0-4f86-9b3b-c54ab81e4869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:46.109433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc52a6d-42f0-4f86-9b3b-c54ab81e4869 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:46.148108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 829/1633] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:45 2022] PUT /identity/v3/projects/145005f5805d45e99b83674e9380c7d1/users/ecced4553f2e4734bf127028391c8028/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:46.149590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712548b-687b-456e-8324-b4d2104d2641 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:46.216090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 805/1634] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:46 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:46.219584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc52a6d-42f0-4f86-9b3b-c54ab81e4869 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:46.280023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712548b-687b-456e-8324-b4d2104d2641 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:46.345849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc52a6d-42f0-4f86-9b3b-c54ab81e4869 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:46.359793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9659072-1dad-40d4-bcd1-cf7b032dde32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:46.362017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9659072-1dad-40d4-bcd1-cf7b032dde32 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.363091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9659072-1dad-40d4-bcd1-cf7b032dde32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.363384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9659072-1dad-40d4-bcd1-cf7b032dde32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.368467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9659072-1dad-40d4-bcd1-cf7b032dde32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:46.374370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9659072-1dad-40d4-bcd1-cf7b032dde32 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:46.388278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396519e-a1d2-4b6f-b65e-11a3756d4dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:46.390516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396519e-a1d2-4b6f-b65e-11a3756d4dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.391056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396519e-a1d2-4b6f-b65e-11a3756d4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.392100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396519e-a1d2-4b6f-b65e-11a3756d4dca admin admin] PATH_INFO: `/v3/projects/2d8fb4784673408c91aec93472ee475d/users/d0bcd17daeca4c18b964ae2af6348df4/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.395123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396519e-a1d2-4b6f-b65e-11a3756d4dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8fb4784673408c91aec93472ee475d, user_id=d0bcd17daeca4c18b964ae2af6348df4, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:46.398473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396519e-a1d2-4b6f-b65e-11a3756d4dca admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:46.400818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 806/1635] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:46.404086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3acb-5914-4a5a-9689-861059e8aa90 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.405791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3acb-5914-4a5a-9689-861059e8aa90 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.406622 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3acb-5914-4a5a-9689-861059e8aa90 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.410218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 807/1636] 10.222.0.58 () {54 vars in 912 bytes} [Wed Aug 24 08:02:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:46.411517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3acb-5914-4a5a-9689-861059e8aa90 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:46.415796 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 830/1637] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:46 2022] PUT /identity/v3/projects/2d8fb4784673408c91aec93472ee475d/users/d0bcd17daeca4c18b964ae2af6348df4/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:46.416870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396519e-a1d2-4b6f-b65e-11a3756d4dca admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:46.538406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3acb-5914-4a5a-9689-861059e8aa90 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:46.548361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4e9b6-7f35-4820-a446-36886bb0f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:46.550446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4e9b6-7f35-4820-a446-36886bb0f590 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.550883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4e9b6-7f35-4820-a446-36886bb0f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.551312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4e9b6-7f35-4820-a446-36886bb0f590 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.552258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4e9b6-7f35-4820-a446-36886bb0f590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:46.554847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4e9b6-7f35-4820-a446-36886bb0f590 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:46.589176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396519e-a1d2-4b6f-b65e-11a3756d4dca admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:46.604694 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946afb4-fd75-4f1e-b48b-19a7254c292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:46.607072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946afb4-fd75-4f1e-b48b-19a7254c292e admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.607359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946afb4-fd75-4f1e-b48b-19a7254c292e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.607680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946afb4-fd75-4f1e-b48b-19a7254c292e admin admin] PATH_INFO: `/v3/projects/145005f5805d45e99b83674e9380c7d1/users/ecced4553f2e4734bf127028391c8028/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.611104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946afb4-fd75-4f1e-b48b-19a7254c292e admin admin] RBAC: Authorizing `identity:create_grant(project_id=145005f5805d45e99b83674e9380c7d1, user_id=ecced4553f2e4734bf127028391c8028, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:46.615451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946afb4-fd75-4f1e-b48b-19a7254c292e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:46.655160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 831/1638] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:46 2022] PUT /identity/v3/projects/145005f5805d45e99b83674e9380c7d1/users/ecced4553f2e4734bf127028391c8028/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:46.655160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbba9a-9026-4feb-b146-7f5953e61299 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.655160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbba9a-9026-4feb-b146-7f5953e61299 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.655160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbba9a-9026-4feb-b146-7f5953e61299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.694624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 808/1639] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:46 2022] POST /identity/v3/users => generated 295 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:46.697213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e3322-c0eb-4a48-afc4-33aa404bca6f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.698686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e3322-c0eb-4a48-afc4-33aa404bca6f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.699904 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e3322-c0eb-4a48-afc4-33aa404bca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.928957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:46.928957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-48fbba9a-9026-4feb-b146-7f5953e61299 None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:46.928957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-48fbba9a-9026-4feb-b146-7f5953e61299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:46.929780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:46.929780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0d3e3322-c0eb-4a48-afc4-33aa404bca6f None None] MFA Rules not processed for user `d0bcd17daeca4c18b964ae2af6348df4`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:46.929780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0d3e3322-c0eb-4a48-afc4-33aa404bca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:46.930129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 832/1640] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:02:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:46.930129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72defd-59e5-4859-842a-8196585512a5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.930129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72defd-59e5-4859-842a-8196585512a5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.930129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72defd-59e5-4859-842a-8196585512a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.930488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 809/1641] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:46.930488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e3322-c0eb-4a48-afc4-33aa404bca6f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:46.932767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-aa72defd-59e5-4859-842a-8196585512a5 None None] MFA Rules not processed for user `ecced4553f2e4734bf127028391c8028`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:46.934819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-aa72defd-59e5-4859-842a-8196585512a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:46.973810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e3322-c0eb-4a48-afc4-33aa404bca6f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:46.978986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db915e6-b076-4186-b7cf-e47d52cf6d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:46.979717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db915e6-b076-4186-b7cf-e47d52cf6d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.980971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db915e6-b076-4186-b7cf-e47d52cf6d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.981287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db915e6-b076-4186-b7cf-e47d52cf6d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.981976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db915e6-b076-4186-b7cf-e47d52cf6d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:46.983602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db915e6-b076-4186-b7cf-e47d52cf6d5b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:46.999419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 810/1642] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:47.000844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db915e6-b076-4186-b7cf-e47d52cf6d5b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:47.103598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 833/1643] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:47.104284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72defd-59e5-4859-842a-8196585512a5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:47.209050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db915e6-b076-4186-b7cf-e47d52cf6d5b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:47.221126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b145d81-8736-492a-9132-01b8c1658d3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:47.221789 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b145d81-8736-492a-9132-01b8c1658d3f service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:47.222077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b145d81-8736-492a-9132-01b8c1658d3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:47.222338 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b145d81-8736-492a-9132-01b8c1658d3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:47.228053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72defd-59e5-4859-842a-8196585512a5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:47.238204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b145d81-8736-492a-9132-01b8c1658d3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:47.239311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435e77-7e67-47e9-aaea-5f474a4e3ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:47.240405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435e77-7e67-47e9-aaea-5f474a4e3ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:47.240774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435e77-7e67-47e9-aaea-5f474a4e3ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:47.241397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435e77-7e67-47e9-aaea-5f474a4e3ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:47.243207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b145d81-8736-492a-9132-01b8c1658d3f service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:47.258776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435e77-7e67-47e9-aaea-5f474a4e3ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:47.260377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435e77-7e67-47e9-aaea-5f474a4e3ae4 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:47.273184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 834/1644] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:47.274116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435e77-7e67-47e9-aaea-5f474a4e3ae4 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:47.286352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 811/1645] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:47.288893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435e77-7e67-47e9-aaea-5f474a4e3ae4 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:47.294853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8663b-f23f-49eb-b404-709d93cbc0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:47.295612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8663b-f23f-49eb-b404-709d93cbc0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:47.295956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8663b-f23f-49eb-b404-709d93cbc0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:47.296315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8663b-f23f-49eb-b404-709d93cbc0f8 admin admin] PATH_INFO: `/v3/projects/230870a4bf4342e695643a7b64f79fc7/users/bd05ab876c714c1b80cbddcb1532d08e/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:47.323752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8663b-f23f-49eb-b404-709d93cbc0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230870a4bf4342e695643a7b64f79fc7, user_id=bd05ab876c714c1b80cbddcb1532d08e, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:47.328819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8663b-f23f-49eb-b404-709d93cbc0f8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:47.439823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 835/1646] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:47 2022] PUT /identity/v3/projects/230870a4bf4342e695643a7b64f79fc7/users/bd05ab876c714c1b80cbddcb1532d08e/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:47.440312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b145d81-8736-492a-9132-01b8c1658d3f service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:47.451302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b145d81-8736-492a-9132-01b8c1658d3f service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:47.520878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8663b-f23f-49eb-b404-709d93cbc0f8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:47.594942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac8e5c-a18d-4ab5-8ff5-71c31eb49f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:47.594942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac8e5c-a18d-4ab5-8ff5-71c31eb49f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:47.594942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac8e5c-a18d-4ab5-8ff5-71c31eb49f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:47.594942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac8e5c-a18d-4ab5-8ff5-71c31eb49f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:47.595248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac8e5c-a18d-4ab5-8ff5-71c31eb49f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:47.596500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac8e5c-a18d-4ab5-8ff5-71c31eb49f34 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:47.622241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 812/1647] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:47.623194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac8e5c-a18d-4ab5-8ff5-71c31eb49f34 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:47.633785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8663b-f23f-49eb-b404-709d93cbc0f8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:47.639737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6abfc-26c9-4791-8a02-b1915ec7774c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:47.640480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6abfc-26c9-4791-8a02-b1915ec7774c service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:47.640899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6abfc-26c9-4791-8a02-b1915ec7774c service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:47.641428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6abfc-26c9-4791-8a02-b1915ec7774c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:47.647361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac8e5c-a18d-4ab5-8ff5-71c31eb49f34 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:47.659616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d38ba7-1a3a-4777-8669-8c3f94438524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:47.660300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d38ba7-1a3a-4777-8669-8c3f94438524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:47.660580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d38ba7-1a3a-4777-8669-8c3f94438524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:47.660856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d38ba7-1a3a-4777-8669-8c3f94438524 admin admin] PATH_INFO: `/v3/projects/230870a4bf4342e695643a7b64f79fc7/users/bd05ab876c714c1b80cbddcb1532d08e/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:47.663947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d38ba7-1a3a-4777-8669-8c3f94438524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230870a4bf4342e695643a7b64f79fc7, user_id=bd05ab876c714c1b80cbddcb1532d08e, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:47.667512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d38ba7-1a3a-4777-8669-8c3f94438524 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:47.697834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 813/1648] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:47 2022] PUT /identity/v3/projects/230870a4bf4342e695643a7b64f79fc7/users/bd05ab876c714c1b80cbddcb1532d08e/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:47.708643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270bce-dd0a-4a1a-99bc-fb0a1d5c74e8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:47.709025 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270bce-dd0a-4a1a-99bc-fb0a1d5c74e8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:47.709533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9270bce-dd0a-4a1a-99bc-fb0a1d5c74e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:47.781760 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c9270bce-dd0a-4a1a-99bc-fb0a1d5c74e8 None None] MFA Rules not processed for user `bd05ab876c714c1b80cbddcb1532d08e`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:47.784363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c9270bce-dd0a-4a1a-99bc-fb0a1d5c74e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:47.805929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6abfc-26c9-4791-8a02-b1915ec7774c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:47.808264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6abfc-26c9-4791-8a02-b1915ec7774c service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:47.830035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 836/1649] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:47.878031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:47.918758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:47.944122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 814/1650] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:48.177298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6abfc-26c9-4791-8a02-b1915ec7774c service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:48.194615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6abfc-26c9-4791-8a02-b1915ec7774c service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:48.348815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fd4dd-54a5-45ed-95cd-4956f7480bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:48.351699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fd4dd-54a5-45ed-95cd-4956f7480bbc service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:48.352521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fd4dd-54a5-45ed-95cd-4956f7480bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:48.354651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fd4dd-54a5-45ed-95cd-4956f7480bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:48.397052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fd4dd-54a5-45ed-95cd-4956f7480bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:48.399425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fd4dd-54a5-45ed-95cd-4956f7480bbc service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:48.423659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 837/1651] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:48.717558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270bce-dd0a-4a1a-99bc-fb0a1d5c74e8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:48.730448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9270bce-dd0a-4a1a-99bc-fb0a1d5c74e8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:48.742363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be83c78-d50d-4710-bfce-cfa6c53c38a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:48.743077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be83c78-d50d-4710-bfce-cfa6c53c38a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:48.743430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be83c78-d50d-4710-bfce-cfa6c53c38a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:48.743773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be83c78-d50d-4710-bfce-cfa6c53c38a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:48.855663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be83c78-d50d-4710-bfce-cfa6c53c38a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:48.859945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be83c78-d50d-4710-bfce-cfa6c53c38a4 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:48.884559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 815/1652] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:48.910021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fd4dd-54a5-45ed-95cd-4956f7480bbc service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:48.914375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:48.920809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fd4dd-54a5-45ed-95cd-4956f7480bbc service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:48.931376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdd13f-ddf7-4d9e-941d-2cdafb020c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:48.934128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd13f-ddf7-4d9e-941d-2cdafb020c78 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:48.934420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd13f-ddf7-4d9e-941d-2cdafb020c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:48.934691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd13f-ddf7-4d9e-941d-2cdafb020c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:49.003956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:49.146243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdd13f-ddf7-4d9e-941d-2cdafb020c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:49.149428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdd13f-ddf7-4d9e-941d-2cdafb020c78 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:49.173016 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 838/1653] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:49.868672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105cef-1433-4a85-a7dd-e60c886d4a16 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:49.869873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105cef-1433-4a85-a7dd-e60c886d4a16 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:49.870376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef105cef-1433-4a85-a7dd-e60c886d4a16 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:49.875395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 816/1654] 10.222.0.58 () {54 vars in 962 bytes} [Wed Aug 24 08:02:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:49.886807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f882dd-613a-4483-b6eb-af653e773f3f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:49.887257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f882dd-613a-4483-b6eb-af653e773f3f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:49.887529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f882dd-613a-4483-b6eb-af653e773f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:49.924787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-06f882dd-613a-4483-b6eb-af653e773f3f None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:49.926117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-06f882dd-613a-4483-b6eb-af653e773f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:50.071800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 839/1655] 10.222.0.58 () {58 vars in 1059 bytes} [Wed Aug 24 08:02:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:50.078980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a819129-4883-49f4-90d0-3c5f811bc3f0 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:50.079346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a819129-4883-49f4-90d0-3c5f811bc3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:50.081049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a819129-4883-49f4-90d0-3c5f811bc3f0 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:50.087026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 817/1656] 10.222.0.58 () {54 vars in 912 bytes} [Wed Aug 24 08:02:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:50.089419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8785e-6457-4395-b808-757cc0f0d539 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:50.090752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8785e-6457-4395-b808-757cc0f0d539 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:50.092808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8785e-6457-4395-b808-757cc0f0d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:50.150234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d4f8785e-6457-4395-b808-757cc0f0d539 None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:50.151172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d4f8785e-6457-4395-b808-757cc0f0d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:50.181320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 840/1657] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:02:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:50.330093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a819129-4883-49f4-90d0-3c5f811bc3f0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:50.351957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a819129-4883-49f4-90d0-3c5f811bc3f0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:50.379135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b0008-1922-4c2b-882a-079f160f5549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:50.394441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0008-1922-4c2b-882a-079f160f5549 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:50.394969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0008-1922-4c2b-882a-079f160f5549 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:50.395378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b0008-1922-4c2b-882a-079f160f5549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:50.453049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b0008-1922-4c2b-882a-079f160f5549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:50.453049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b0008-1922-4c2b-882a-079f160f5549 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:50.472134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 818/1658] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:52.802279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8785e-6457-4395-b808-757cc0f0d539 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:52.891960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ce8a6-e0cf-46cd-93ee-96a3b2efaf33 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:52.892909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ce8a6-e0cf-46cd-93ee-96a3b2efaf33 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:52.893213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ce8a6-e0cf-46cd-93ee-96a3b2efaf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:52.993712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-412ce8a6-e0cf-46cd-93ee-96a3b2efaf33 None None] MFA Rules not processed for user `37e7ea97f58341fc99b168ee30503594`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:52.993712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-412ce8a6-e0cf-46cd-93ee-96a3b2efaf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:53.017966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8785e-6457-4395-b808-757cc0f0d539 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:53.036600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:53.043360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:53.043360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:53.043360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] PATH_INFO: `/v3/users/7fd652ca8c6845fca2da1fe2ae125f1f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:53.045277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd652ca8c6845fca2da1fe2ae125f1f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:53.046521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:02:53.046521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: warnings.warn(msg) Aug 24 08:02:53.046521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: Aug 24 08:02:53.049751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:53.234138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 819/1659] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:53.243387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d71c3-5b7e-427d-9e36-b70a2690b6cc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:53.243979 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d71c3-5b7e-427d-9e36-b70a2690b6cc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:53.244415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d71c3-5b7e-427d-9e36-b70a2690b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:53.289808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:53.305866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-514d71c3-5b7e-427d-9e36-b70a2690b6cc None None] MFA Rules not processed for user `37e7ea97f58341fc99b168ee30503594`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:53.307363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-514d71c3-5b7e-427d-9e36-b70a2690b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:53.332907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 820/1660] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:02:53.345369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d71c3-5b7e-427d-9e36-b70a2690b6cc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:53.374069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d71c3-5b7e-427d-9e36-b70a2690b6cc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:53.386092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85904fd3-cded-4ea1-a0a4-9ee1ab6a911c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:53.387046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85904fd3-cded-4ea1-a0a4-9ee1ab6a911c service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:53.387557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85904fd3-cded-4ea1-a0a4-9ee1ab6a911c service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:53.388476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85904fd3-cded-4ea1-a0a4-9ee1ab6a911c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:53.401560 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85904fd3-cded-4ea1-a0a4-9ee1ab6a911c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:53.404148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85904fd3-cded-4ea1-a0a4-9ee1ab6a911c service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:53.419471 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 821/1661] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:53.438388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd652ca8c6845fca2da1fe2ae125f1f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:53.441617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd652ca8c6845fca2da1fe2ae125f1f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:53.441617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd652ca8c6845fca2da1fe2ae125f1f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:53.540578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd652ca8c6845fca2da1fe2ae125f1f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:53.580909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd652ca8c6845fca2da1fe2ae125f1f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:53.642310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 841/1662] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:02:52 2022] DELETE /identity/v3/users/7fd652ca8c6845fca2da1fe2ae125f1f => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:53.646504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44a582-c4c2-4310-8c88-f00deaa2d3a0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:53.646790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44a582-c4c2-4310-8c88-f00deaa2d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:53.647064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44a582-c4c2-4310-8c88-f00deaa2d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:53.694483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ca44a582-c4c2-4310-8c88-f00deaa2d3a0 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:53.695724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ca44a582-c4c2-4310-8c88-f00deaa2d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:53.883771 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 822/1663] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:54.042348 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:54.048241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:54.320587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61473161-31a7-422e-85f9-a292329de3a4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:54.338526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093d372-c7d4-403d-a929-74afeb6de8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:54.339169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093d372-c7d4-403d-a929-74afeb6de8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:54.339491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093d372-c7d4-403d-a929-74afeb6de8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:54.339751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093d372-c7d4-403d-a929-74afeb6de8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:54.377505 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093d372-c7d4-403d-a929-74afeb6de8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:54.381650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093d372-c7d4-403d-a929-74afeb6de8c6 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:54.409929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 842/1664] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:54.438417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e5dc6-d992-4102-9216-c2857658cb5a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:54.438868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e5dc6-d992-4102-9216-c2857658cb5a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:54.439555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e5dc6-d992-4102-9216-c2857658cb5a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:54.441452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 823/1665] 10.222.0.58 () {54 vars in 912 bytes} [Wed Aug 24 08:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:54.447628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57ab51-8f49-41a3-924f-63292b2692b0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:54.448070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57ab51-8f49-41a3-924f-63292b2692b0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:54.448515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57ab51-8f49-41a3-924f-63292b2692b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:54.562768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4c57ab51-8f49-41a3-924f-63292b2692b0 None None] MFA Rules not processed for user `321d07f93b7540128dc5415d8b3252c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:54.564293 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4c57ab51-8f49-41a3-924f-63292b2692b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:54.587020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 843/1666] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:02:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:54.836336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e5dc6-d992-4102-9216-c2857658cb5a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:54.854200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e5dc6-d992-4102-9216-c2857658cb5a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:54.871262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a46b0-dd7d-49b1-82d6-fbf9926c80b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:54.882603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a46b0-dd7d-49b1-82d6-fbf9926c80b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:54.885957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a46b0-dd7d-49b1-82d6-fbf9926c80b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:54.885957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a46b0-dd7d-49b1-82d6-fbf9926c80b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:54.920509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a46b0-dd7d-49b1-82d6-fbf9926c80b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:54.920509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a46b0-dd7d-49b1-82d6-fbf9926c80b4 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:54.954326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 824/1667] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:55.354474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57ab51-8f49-41a3-924f-63292b2692b0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:55.357037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4c57ab51-8f49-41a3-924f-63292b2692b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:55.384708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57ab51-8f49-41a3-924f-63292b2692b0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:55.395489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:55.396155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:55.396948 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:55.397229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] PATH_INFO: `/v3/users/2aaa1f36928547248ab3eb98c68226be` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:55.399186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aaa1f36928547248ab3eb98c68226be)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:55.404765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:55.678458 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aaa1f36928547248ab3eb98c68226be'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:55.681442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aaa1f36928547248ab3eb98c68226be'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:55.682535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a46b0-dd7d-49b1-82d6-fbf9926c80b4 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:55.683248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aaa1f36928547248ab3eb98c68226be'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:55.687673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7a6a46b0-dd7d-49b1-82d6-fbf9926c80b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:55.710859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a46b0-dd7d-49b1-82d6-fbf9926c80b4 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:55.731045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:55.731890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:55.732224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:55.732659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] PATH_INFO: `/v3/users/37add1c9f3774ab0bbb0ff5cb0ed1bd9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:55.735583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37add1c9f3774ab0bbb0ff5cb0ed1bd9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:55.739848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:55.744734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:55.793126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aaa1f36928547248ab3eb98c68226be'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:55.814845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3787ca54-5235-4904-bf03-fce5998e4e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aaa1f36928547248ab3eb98c68226be'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:55.843363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:55.860455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 844/1668] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:02:55 2022] DELETE /identity/v3/users/2aaa1f36928547248ab3eb98c68226be => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:55.865852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3c5fc-1121-480b-9cd5-50fe8a4dd380 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:55.866133 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3c5fc-1121-480b-9cd5-50fe8a4dd380 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:55.869440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3c5fc-1121-480b-9cd5-50fe8a4dd380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:56.005064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-79d3c5fc-1121-480b-9cd5-50fe8a4dd380 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:56.006635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37add1c9f3774ab0bbb0ff5cb0ed1bd9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.015618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-79d3c5fc-1121-480b-9cd5-50fe8a4dd380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:56.027838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37add1c9f3774ab0bbb0ff5cb0ed1bd9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.030985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37add1c9f3774ab0bbb0ff5cb0ed1bd9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.030985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37add1c9f3774ab0bbb0ff5cb0ed1bd9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.106443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6891020a-2770-443e-b9eb-ee6c888c9304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37add1c9f3774ab0bbb0ff5cb0ed1bd9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.145885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 825/1669] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:02:55 2022] DELETE /identity/v3/users/37add1c9f3774ab0bbb0ff5cb0ed1bd9 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:02:56.148240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8d8e6-852f-4a84-ab4a-6b706ef3f5a4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:56.148525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8d8e6-852f-4a84-ab4a-6b706ef3f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:56.148796 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8d8e6-852f-4a84-ab4a-6b706ef3f5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:56.205766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ccb8d8e6-852f-4a84-ab4a-6b706ef3f5a4 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:56.211157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ccb8d8e6-852f-4a84-ab4a-6b706ef3f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:56.280058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 845/1670] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:56.310095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3c5fc-1121-480b-9cd5-50fe8a4dd380 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:56.311606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-79d3c5fc-1121-480b-9cd5-50fe8a4dd380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:56.340925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3c5fc-1121-480b-9cd5-50fe8a4dd380 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:56.397015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 826/1671] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:56.435435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8d8e6-852f-4a84-ab4a-6b706ef3f5a4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:56.439370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ccb8d8e6-852f-4a84-ab4a-6b706ef3f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:56.521665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:56.522459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:56.522745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:56.523018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] PATH_INFO: `/v3/users/53cbeea9dfac4cab928fbaefcef7e696` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:56.530167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53cbeea9dfac4cab928fbaefcef7e696)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:56.535158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:56.594651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8d8e6-852f-4a84-ab4a-6b706ef3f5a4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:56.616833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b3b6-7d78-4e92-b331-a55d85a7376a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:56.617886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b3b6-7d78-4e92-b331-a55d85a7376a service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:56.618398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b3b6-7d78-4e92-b331-a55d85a7376a service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:56.619198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b3b6-7d78-4e92-b331-a55d85a7376a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:56.682685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95b3b6-7d78-4e92-b331-a55d85a7376a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:56.689836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95b3b6-7d78-4e92-b331-a55d85a7376a service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:56.721253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 827/1672] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:02:56.722250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b3b6-7d78-4e92-b331-a55d85a7376a service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:56.726602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ad95b3b6-7d78-4e92-b331-a55d85a7376a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:56.760299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b3b6-7d78-4e92-b331-a55d85a7376a service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:56.779022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae0d4-b6fe-4e56-863e-c3c884e388f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:56.779655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae0d4-b6fe-4e56-863e-c3c884e388f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:56.779935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae0d4-b6fe-4e56-863e-c3c884e388f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:56.780209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae0d4-b6fe-4e56-863e-c3c884e388f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:56.826745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ae0d4-b6fe-4e56-863e-c3c884e388f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:56.836783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ae0d4-b6fe-4e56-863e-c3c884e388f6 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:56.853501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 828/1673] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:56.858137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53cbeea9dfac4cab928fbaefcef7e696'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.859795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53cbeea9dfac4cab928fbaefcef7e696'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.864782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53cbeea9dfac4cab928fbaefcef7e696'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.880502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae0d4-b6fe-4e56-863e-c3c884e388f6 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:56.895934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-802ae0d4-b6fe-4e56-863e-c3c884e388f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:56.924561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae0d4-b6fe-4e56-863e-c3c884e388f6 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:56.937925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:56.938655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:56.939204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:56.939646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] PATH_INFO: `/v3/projects/98c96fa0cc84461dbc7ba9e310db982c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:56.940472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53cbeea9dfac4cab928fbaefcef7e696'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.944673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c96fa0cc84461dbc7ba9e310db982c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:56.946536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:02:56.946536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: warnings.warn(msg) Aug 24 08:02:56.946536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: Aug 24 08:02:56.948039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:56.957592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:56.962096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a158cc98-a538-4085-9e7e-1b364beb492a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53cbeea9dfac4cab928fbaefcef7e696'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:56.987774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 846/1674] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:02:56 2022] DELETE /identity/v3/users/53cbeea9dfac4cab928fbaefcef7e696 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:56.989159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820508-e540-40ed-8b91-768c017282ad None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:56.989448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820508-e540-40ed-8b91-768c017282ad None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:56.989747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820508-e540-40ed-8b91-768c017282ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.048180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-08820508-e540-40ed-8b91-768c017282ad None None] MFA Rules not processed for user `af1baafb29de4485b4712a29fdfaf9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:57.051602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-08820508-e540-40ed-8b91-768c017282ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:57.143563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c96fa0cc84461dbc7ba9e310db982c', 'request_id': 'req-3053d8d3-83ca-4589-8bc3-df92ecfd862c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:57.161273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c96fa0cc84461dbc7ba9e310db982c', 'request_id': 'req-3053d8d3-83ca-4589-8bc3-df92ecfd862c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:57.172368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 847/1675] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:57.174083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f59a8-c3ed-4151-992b-b649296710e8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:57.174083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f59a8-c3ed-4151-992b-b649296710e8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:57.174359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f59a8-c3ed-4151-992b-b649296710e8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.179869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 848/1676] 10.222.0.58 () {54 vars in 961 bytes} [Wed Aug 24 08:02:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:57.182204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6428b-6c56-4331-9240-4a35a9b77393 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:57.182493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6428b-6c56-4331-9240-4a35a9b77393 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:57.182766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6428b-6c56-4331-9240-4a35a9b77393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.210346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c96fa0cc84461dbc7ba9e310db982c', 'request_id': 'req-3053d8d3-83ca-4589-8bc3-df92ecfd862c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:57.228538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-83d6428b-6c56-4331-9240-4a35a9b77393 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:57.235539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-83d6428b-6c56-4331-9240-4a35a9b77393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:57.302730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] The token cache is being invalidate because project 98c96fa0cc84461dbc7ba9e310db982c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:02:57.303189 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:57.304887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3053d8d3-83ca-4589-8bc3-df92ecfd862c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:57.313949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 829/1677] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:02:56 2022] DELETE /identity/v3/projects/98c96fa0cc84461dbc7ba9e310db982c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:57.313949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407ca4-67b0-4d9b-8c93-825cc435d16d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:57.325527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407ca4-67b0-4d9b-8c93-825cc435d16d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:57.325527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407ca4-67b0-4d9b-8c93-825cc435d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.374074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 849/1678] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:57.374074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa478123-a51d-4094-9e1a-3cd550ec5456 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:57.374074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa478123-a51d-4094-9e1a-3cd550ec5456 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:57.374074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa478123-a51d-4094-9e1a-3cd550ec5456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.383828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-22407ca4-67b0-4d9b-8c93-825cc435d16d None None] MFA Rules not processed for user `00093949026746f29def86e4a0b48bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:57.386616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-22407ca4-67b0-4d9b-8c93-825cc435d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:57.415337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-fa478123-a51d-4094-9e1a-3cd550ec5456 None None] MFA Rules not processed for user `af1baafb29de4485b4712a29fdfaf9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:57.419217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fa478123-a51d-4094-9e1a-3cd550ec5456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:57.555526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 830/1679] 10.222.0.58 () {58 vars in 1058 bytes} [Wed Aug 24 08:02:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:57.559613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135f046-e4a1-41e0-9422-fd56d9c1aabf None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:57.559904 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135f046-e4a1-41e0-9422-fd56d9c1aabf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:57.560156 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135f046-e4a1-41e0-9422-fd56d9c1aabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.583512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 850/1680] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:57.584720 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa478123-a51d-4094-9e1a-3cd550ec5456 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:57.590189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fa478123-a51d-4094-9e1a-3cd550ec5456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:57.624838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2135f046-e4a1-41e0-9422-fd56d9c1aabf None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:57.627306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2135f046-e4a1-41e0-9422-fd56d9c1aabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:57.657966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 831/1681] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:57.660606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135f046-e4a1-41e0-9422-fd56d9c1aabf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:57.688883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135f046-e4a1-41e0-9422-fd56d9c1aabf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:57.708895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:57.710060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:57.710527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:57.710975 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.719858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:57.742073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa478123-a51d-4094-9e1a-3cd550ec5456 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:57.752351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:57.752765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77edd6-1ef1-4819-abef-04a610e4e8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:57.753412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77edd6-1ef1-4819-abef-04a610e4e8ec service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:57.753716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77edd6-1ef1-4819-abef-04a610e4e8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:57.753985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77edd6-1ef1-4819-abef-04a610e4e8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.758820 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:57.787431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77edd6-1ef1-4819-abef-04a610e4e8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:57.793278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77edd6-1ef1-4819-abef-04a610e4e8ec service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:57.793421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 832/1682] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:57.793517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:57.798978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:57.846963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:57.848199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 851/1683] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:57.859425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e15f45-d4a4-47e4-89ac-ec37ab4adc44 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:57.870207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e15f45-d4a4-47e4-89ac-ec37ab4adc44 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:57.870605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e15f45-d4a4-47e4-89ac-ec37ab4adc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.922544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b1e15f45-d4a4-47e4-89ac-ec37ab4adc44 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:57.925856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b1e15f45-d4a4-47e4-89ac-ec37ab4adc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:57.947898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 852/1684] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:57.951863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e15f45-d4a4-47e4-89ac-ec37ab4adc44 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:57.974782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027520f-dda3-419b-97e5-32dc7441be99 service placement] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:57.975342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e15f45-d4a4-47e4-89ac-ec37ab4adc44 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:57.993878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6567768-18ec-44ca-9531-e43a95e88a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:57.994520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6567768-18ec-44ca-9531-e43a95e88a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:57.994797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6567768-18ec-44ca-9531-e43a95e88a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:57.995064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6567768-18ec-44ca-9531-e43a95e88a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:57.995795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6567768-18ec-44ca-9531-e43a95e88a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:02:57.996096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6567768-18ec-44ca-9531-e43a95e88a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:57.997442 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a7072-8640-418a-a9a7-694db9791207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:58.002741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6567768-18ec-44ca-9531-e43a95e88a1d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:58.002871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a7072-8640-418a-a9a7-694db9791207 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:58.002871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a7072-8640-418a-a9a7-694db9791207 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:58.002871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a7072-8640-418a-a9a7-694db9791207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:58.006104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f50a7072-8640-418a-a9a7-694db9791207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:58.025506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 853/1685] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:02:58.028531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6567768-18ec-44ca-9531-e43a95e88a1d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:58.035612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a7072-8640-418a-a9a7-694db9791207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:58.037613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a7072-8640-418a-a9a7-694db9791207 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:58.054536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6567768-18ec-44ca-9531-e43a95e88a1d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:58.063391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d5691-dafc-4964-8708-a9bd62944498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:58.064021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d5691-dafc-4964-8708-a9bd62944498 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:58.064454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d5691-dafc-4964-8708-a9bd62944498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:58.065212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d5691-dafc-4964-8708-a9bd62944498 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:58.066309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d5691-dafc-4964-8708-a9bd62944498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:58.068400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d5691-dafc-4964-8708-a9bd62944498 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:58.082949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 833/1686] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:58.212501 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 854/1687] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:58 2022] POST /identity/v3/projects => generated 403 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:58.218447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a7072-8640-418a-a9a7-694db9791207 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:58.246466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a7072-8640-418a-a9a7-694db9791207 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:58.377964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c81e0-ab02-4d8b-b749-f87bc9189aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:58.378584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c81e0-ab02-4d8b-b749-f87bc9189aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:58.378905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c81e0-ab02-4d8b-b749-f87bc9189aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:58.379162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c81e0-ab02-4d8b-b749-f87bc9189aaf admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:58.380043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c81e0-ab02-4d8b-b749-f87bc9189aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:58.382066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c81e0-ab02-4d8b-b749-f87bc9189aaf admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:58.483717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:58.577099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 834/1688] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:02:58 2022] POST /identity/v3/users => generated 302 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:02:58.581248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d5691-dafc-4964-8708-a9bd62944498 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:58.593667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d5691-dafc-4964-8708-a9bd62944498 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:58.604748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e2ad-12d7-4bf9-97e1-02f1202f43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:58.606440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e2ad-12d7-4bf9-97e1-02f1202f43d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:58.606941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e2ad-12d7-4bf9-97e1-02f1202f43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:58.607411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e2ad-12d7-4bf9-97e1-02f1202f43d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:58.608475 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e2ad-12d7-4bf9-97e1-02f1202f43d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:58.610415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e2ad-12d7-4bf9-97e1-02f1202f43d2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:58.640171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c81e0-ab02-4d8b-b749-f87bc9189aaf admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:58.641805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 855/1689] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:58.660683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c81e0-ab02-4d8b-b749-f87bc9189aaf admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:58.669416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010044-2035-498a-899b-4fedd60d28a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:58.671805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010044-2035-498a-899b-4fedd60d28a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:58.672525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010044-2035-498a-899b-4fedd60d28a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:58.673108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010044-2035-498a-899b-4fedd60d28a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:58.674010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010044-2035-498a-899b-4fedd60d28a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:58.676344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010044-2035-498a-899b-4fedd60d28a6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:58.694079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 835/1690] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:02:58.694737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e2ad-12d7-4bf9-97e1-02f1202f43d2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:58.708297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e2ad-12d7-4bf9-97e1-02f1202f43d2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:58.733260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115937d-a398-4226-8b00-6160bce7277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:58.747140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115937d-a398-4226-8b00-6160bce7277a admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:58.747669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115937d-a398-4226-8b00-6160bce7277a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:58.748111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115937d-a398-4226-8b00-6160bce7277a admin admin] PATH_INFO: `/v3/projects/2c1d1d79bc7b48f4942aef8315f4d05e/users/11e83278ae4a4511879f2152ef0b22e6/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:58.805893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115937d-a398-4226-8b00-6160bce7277a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1d1d79bc7b48f4942aef8315f4d05e, user_id=11e83278ae4a4511879f2152ef0b22e6, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:58.809256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115937d-a398-4226-8b00-6160bce7277a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:58.860342 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe758d5-05ea-4b81-aa3e-f74f366c4454 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:58.864773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe758d5-05ea-4b81-aa3e-f74f366c4454 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:58.864773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe758d5-05ea-4b81-aa3e-f74f366c4454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:58.934981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-afe758d5-05ea-4b81-aa3e-f74f366c4454 None None] MFA Rules not processed for user `9870363844644da7ad0a353f8ebfeffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:58.939915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-afe758d5-05ea-4b81-aa3e-f74f366c4454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:58.959447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 856/1691] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:02:58 2022] PUT /identity/v3/projects/2c1d1d79bc7b48f4942aef8315f4d05e/users/11e83278ae4a4511879f2152ef0b22e6/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:58.965148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36dc48-bca9-4cf1-80cf-a3ef663a653e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:58.965541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36dc48-bca9-4cf1-80cf-a3ef663a653e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:58.966346 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36dc48-bca9-4cf1-80cf-a3ef663a653e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:59.045797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-bb36dc48-bca9-4cf1-80cf-a3ef663a653e None None] MFA Rules not processed for user `11e83278ae4a4511879f2152ef0b22e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:59.048932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bb36dc48-bca9-4cf1-80cf-a3ef663a653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:59.138128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 836/1692] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:59.143880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe758d5-05ea-4b81-aa3e-f74f366c4454 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:59.146205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-afe758d5-05ea-4b81-aa3e-f74f366c4454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:59.256880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 857/1693] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:02:58 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:59.257987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36dc48-bca9-4cf1-80cf-a3ef663a653e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:59.271349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bb36dc48-bca9-4cf1-80cf-a3ef663a653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:59.278748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:59.421502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe758d5-05ea-4b81-aa3e-f74f366c4454 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:59.440916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:59.441969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:59.444178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:59.445569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] PATH_INFO: `/v3/projects/ec69c9250f484de0b2ce29e6f4c322c0` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:59.446434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec69c9250f484de0b2ce29e6f4c322c0)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:59.452367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:59.490957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36dc48-bca9-4cf1-80cf-a3ef663a653e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:59.503974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:59.503974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:59.503974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:59.503974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] PATH_INFO: `/v3/projects/d3a415b7d49c400f8baa62e3f73d8f3a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:59.506758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a415b7d49c400f8baa62e3f73d8f3a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:59.508695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:59.652936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec69c9250f484de0b2ce29e6f4c322c0', 'request_id': 'req-bc8e7dd4-811f-402f-b5a7-2edbd225556a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.668732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec69c9250f484de0b2ce29e6f4c322c0', 'request_id': 'req-bc8e7dd4-811f-402f-b5a7-2edbd225556a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.694546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec69c9250f484de0b2ce29e6f4c322c0', 'request_id': 'req-bc8e7dd4-811f-402f-b5a7-2edbd225556a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.702597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:59.758997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:59.776132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a415b7d49c400f8baa62e3f73d8f3a', 'request_id': 'req-428f56ef-a2c8-4e51-8598-35124ffc515e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.803756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a415b7d49c400f8baa62e3f73d8f3a', 'request_id': 'req-428f56ef-a2c8-4e51-8598-35124ffc515e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.813839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a415b7d49c400f8baa62e3f73d8f3a', 'request_id': 'req-428f56ef-a2c8-4e51-8598-35124ffc515e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.821107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] The token cache is being invalidate because project ec69c9250f484de0b2ce29e6f4c322c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:02:59.821395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.824537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.827344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 837/1694] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:02:59 2022] DELETE /identity/v3/projects/ec69c9250f484de0b2ce29e6f4c322c0 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:59.828755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:59.838098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:59.873327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] The token cache is being invalidate because project d3a415b7d49c400f8baa62e3f73d8f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:02:59.873900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.874941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:02:59.890334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 858/1695] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:02:59 2022] DELETE /identity/v3/projects/d3a415b7d49c400f8baa62e3f73d8f3a => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:02:59.890334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:59.890334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:00.088415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e7dd4-811f-402f-b5a7-2edbd225556a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:00.089072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f56ef-a2c8-4e51-8598-35124ffc515e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:00.089072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a135e-0aa1-4aa0-9095-bad24f541dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:00.089072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a135e-0aa1-4aa0-9095-bad24f541dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:00.089072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a135e-0aa1-4aa0-9095-bad24f541dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:00.089782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a135e-0aa1-4aa0-9095-bad24f541dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:00.089782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a135e-0aa1-4aa0-9095-bad24f541dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:00.089782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a135e-0aa1-4aa0-9095-bad24f541dd1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:00.202621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:00.203409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:00.203580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:00.204005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:00.206040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:00.263128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 859/1696] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:02:59 2022] POST /identity/v3/projects => generated 401 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:00.266777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a135e-0aa1-4aa0-9095-bad24f541dd1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:00.272631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4b5a135e-0aa1-4aa0-9095-bad24f541dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:00.331686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:00.333675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:00.356460 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 838/1697] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:00.357066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:00.359751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:00.415285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0a46-c564-436b-bb5d-cc25b1aae7e4 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:00.502104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a135e-0aa1-4aa0-9095-bad24f541dd1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:00.513997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:00.515071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:00.515360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:00.522234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] PATH_INFO: `/v3/projects/1bfc8c6c9c9e4d29ab16eb05fd5912bc` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:00.525587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfc8c6c9c9e4d29ab16eb05fd5912bc)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:00.526315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:00.609601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:00.610709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:00.611769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:00.613095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] PATH_INFO: `/v3/users/d0bcd17daeca4c18b964ae2af6348df4` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:00.633158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bcd17daeca4c18b964ae2af6348df4)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:00.635631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:00.748773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:00.756129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfc8c6c9c9e4d29ab16eb05fd5912bc', 'request_id': 'req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:00.770662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfc8c6c9c9e4d29ab16eb05fd5912bc', 'request_id': 'req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:00.794559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfc8c6c9c9e4d29ab16eb05fd5912bc', 'request_id': 'req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:00.907906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] The token cache is being invalidate because project 1bfc8c6c9c9e4d29ab16eb05fd5912bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:00.908203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:00.909838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:00.913893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 860/1698] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:00 2022] DELETE /identity/v3/projects/1bfc8c6c9c9e4d29ab16eb05fd5912bc => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:00.914733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:00.918208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:00.950632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:00.973145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bcd17daeca4c18b964ae2af6348df4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:00.987311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bcd17daeca4c18b964ae2af6348df4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:00.989963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bcd17daeca4c18b964ae2af6348df4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:00.992288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bcd17daeca4c18b964ae2af6348df4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:01.065352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea1a5-e66b-49b0-b867-ea52fd9f69f6 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:01.083395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb38d9eb-f5ac-45b2-836b-14783083e609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bcd17daeca4c18b964ae2af6348df4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:01.091236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:01.091236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:01.091236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:01.091236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] PATH_INFO: `/v3/users/4ab18c7a32f44f26abeb2e8fa10e5b45` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:01.091700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab18c7a32f44f26abeb2e8fa10e5b45)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:01.091700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:01.128735 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 839/1699] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:00 2022] DELETE /identity/v3/users/d0bcd17daeca4c18b964ae2af6348df4 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:01.135248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20317c-9c94-4f3f-bd75-1fff4eda98bd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:01.135466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20317c-9c94-4f3f-bd75-1fff4eda98bd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:01.135685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20317c-9c94-4f3f-bd75-1fff4eda98bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:01.165560 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7a20317c-9c94-4f3f-bd75-1fff4eda98bd None None] MFA Rules not processed for user `af1baafb29de4485b4712a29fdfaf9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:01.171476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7a20317c-9c94-4f3f-bd75-1fff4eda98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:01.342172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 840/1700] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:01.342172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20317c-9c94-4f3f-bd75-1fff4eda98bd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:01.350932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7a20317c-9c94-4f3f-bd75-1fff4eda98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:01.413983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab18c7a32f44f26abeb2e8fa10e5b45'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:01.413983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab18c7a32f44f26abeb2e8fa10e5b45'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:01.414523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab18c7a32f44f26abeb2e8fa10e5b45'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:01.517880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20317c-9c94-4f3f-bd75-1fff4eda98bd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:01.523427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab18c7a32f44f26abeb2e8fa10e5b45'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:01.524180 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a01f5f-b151-49fc-b23f-fbac91ececea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:01.525331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a01f5f-b151-49fc-b23f-fbac91ececea admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:01.537995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a01f5f-b151-49fc-b23f-fbac91ececea admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:01.537995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a01f5f-b151-49fc-b23f-fbac91ececea admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:01.539131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a01f5f-b151-49fc-b23f-fbac91ececea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:01.545304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a01f5f-b151-49fc-b23f-fbac91ececea admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:01.547656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab18c7a32f44f26abeb2e8fa10e5b45'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:01.590603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 861/1701] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:00 2022] DELETE /identity/v3/users/4ab18c7a32f44f26abeb2e8fa10e5b45 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:01.594441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:01.611193 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:01.691818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 841/1702] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:01 2022] POST /identity/v3/users => generated 307 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:01.691818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e920d5-b2d0-4bcc-87f1-f590354e897a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:01.691818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e920d5-b2d0-4bcc-87f1-f590354e897a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:01.691818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e920d5-b2d0-4bcc-87f1-f590354e897a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:01.814913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-22e920d5-b2d0-4bcc-87f1-f590354e897a None None] MFA Rules not processed for user `145c02717fc04c4aa81829de41470262`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:01.816115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690a9b4-f6fa-43e0-bde2-e32dd4c97160 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:01.818438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-22e920d5-b2d0-4bcc-87f1-f590354e897a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:01.831488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:01.832531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:01.848907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:01.858130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] PATH_INFO: `/v3/users/ecced4553f2e4734bf127028391c8028` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:01.864213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecced4553f2e4734bf127028391c8028)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:01.866801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:01.964775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 842/1703] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:01.965581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e920d5-b2d0-4bcc-87f1-f590354e897a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:01.968047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-22e920d5-b2d0-4bcc-87f1-f590354e897a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:01.987549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e920d5-b2d0-4bcc-87f1-f590354e897a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:01.992780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286d01-c7d9-430c-8880-ad166cf2a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:01.993332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286d01-c7d9-430c-8880-ad166cf2a3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:01.993678 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286d01-c7d9-430c-8880-ad166cf2a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:01.994005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286d01-c7d9-430c-8880-ad166cf2a3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:01.994815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed286d01-c7d9-430c-8880-ad166cf2a3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:01.997326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed286d01-c7d9-430c-8880-ad166cf2a3a8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:02.015138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 843/1704] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:02.016212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286d01-c7d9-430c-8880-ad166cf2a3a8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:02.018797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ed286d01-c7d9-430c-8880-ad166cf2a3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:02.153042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecced4553f2e4734bf127028391c8028'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:02.158105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecced4553f2e4734bf127028391c8028'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:02.158839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecced4553f2e4734bf127028391c8028'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:02.182301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286d01-c7d9-430c-8880-ad166cf2a3a8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:02.198731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:02.200448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:02.200739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:02.201393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:02.208456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:02.219332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:02.221175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:02.226579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecced4553f2e4734bf127028391c8028'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:02.238157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 844/1705] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:02.258086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-907621ee-089d-457f-b981-10a260b80327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecced4553f2e4734bf127028391c8028'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:02.260528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:02.272275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:02.284461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 862/1706] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:01 2022] DELETE /identity/v3/users/ecced4553f2e4734bf127028391c8028 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:02.286297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f674eb-814d-4284-8c64-9212a76a9523 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:02.286764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f674eb-814d-4284-8c64-9212a76a9523 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:02.287210 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f674eb-814d-4284-8c64-9212a76a9523 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:02.289709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 863/1707] 10.222.0.58 () {54 vars in 912 bytes} [Wed Aug 24 08:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:02.297959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77a6db-3179-4471-ac16-1c8b89337d32 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:02.298597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77a6db-3179-4471-ac16-1c8b89337d32 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:02.300850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77a6db-3179-4471-ac16-1c8b89337d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:02.329966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb567613-08c2-4362-9aa3-60821b0bd32b service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:02.344477 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ad77a6db-3179-4471-ac16-1c8b89337d32 None None] MFA Rules not processed for user `321d07f93b7540128dc5415d8b3252c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:02.347168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ad77a6db-3179-4471-ac16-1c8b89337d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:02.483354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f394c30-576a-47c9-8a02-bcc9185c3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:02.483821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f394c30-576a-47c9-8a02-bcc9185c3364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:02.484102 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f394c30-576a-47c9-8a02-bcc9185c3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:02.484377 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f394c30-576a-47c9-8a02-bcc9185c3364 admin admin] PATH_INFO: `/v3/projects/e1755a58302a45bf9f5b1237803baa93/users/93dd89c1885846c2abed79bc32b340ca/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:02.525256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 864/1708] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:03:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:02.540213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f394c30-576a-47c9-8a02-bcc9185c3364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1755a58302a45bf9f5b1237803baa93, user_id=93dd89c1885846c2abed79bc32b340ca, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:02.545034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f394c30-576a-47c9-8a02-bcc9185c3364 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:02.578926 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77a6db-3179-4471-ac16-1c8b89337d32 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:02.578926 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ad77a6db-3179-4471-ac16-1c8b89337d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:02.598864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77a6db-3179-4471-ac16-1c8b89337d32 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:02.605762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a6b22-3df1-47fd-b905-f112e6222651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:02.609323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a6b22-3df1-47fd-b905-f112e6222651 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:02.609323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a6b22-3df1-47fd-b905-f112e6222651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:02.609323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a6b22-3df1-47fd-b905-f112e6222651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:02.626730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a6b22-3df1-47fd-b905-f112e6222651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:02.628813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a6b22-3df1-47fd-b905-f112e6222651 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:02.646769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 865/1709] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:02.699715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 845/1710] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:02 2022] PUT /identity/v3/projects/e1755a58302a45bf9f5b1237803baa93/users/93dd89c1885846c2abed79bc32b340ca/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:02.713322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a6b22-3df1-47fd-b905-f112e6222651 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:02.758191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a6b22-3df1-47fd-b905-f112e6222651 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:02.896491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54977f03-7a2b-4593-85cc-cb8ef69058b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:02.897450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54977f03-7a2b-4593-85cc-cb8ef69058b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:02.897771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54977f03-7a2b-4593-85cc-cb8ef69058b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:02.898178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54977f03-7a2b-4593-85cc-cb8ef69058b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:02.900161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54977f03-7a2b-4593-85cc-cb8ef69058b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:02.905052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54977f03-7a2b-4593-85cc-cb8ef69058b8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:02.919478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 866/1711] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:02.924035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f394c30-576a-47c9-8a02-bcc9185c3364 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:02.941201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f394c30-576a-47c9-8a02-bcc9185c3364 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:02.959333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:02.961427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9cd95-9fce-41ad-a514-67aae6a782a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:02.962390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9cd95-9fce-41ad-a514-67aae6a782a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:02.966469 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9cd95-9fce-41ad-a514-67aae6a782a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:02.966469 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9cd95-9fce-41ad-a514-67aae6a782a7 admin admin] PATH_INFO: `/v3/projects/e1755a58302a45bf9f5b1237803baa93/users/93dd89c1885846c2abed79bc32b340ca/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:02.967830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9cd95-9fce-41ad-a514-67aae6a782a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1755a58302a45bf9f5b1237803baa93, user_id=93dd89c1885846c2abed79bc32b340ca, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:02.975565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9cd95-9fce-41ad-a514-67aae6a782a7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:03.019946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 846/1712] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:02 2022] PUT /identity/v3/projects/e1755a58302a45bf9f5b1237803baa93/users/93dd89c1885846c2abed79bc32b340ca/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:03.035192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d99689-efa9-4fba-a9ef-552294ad57c4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:03.035486 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d99689-efa9-4fba-a9ef-552294ad57c4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:03.035767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d99689-efa9-4fba-a9ef-552294ad57c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:03.071779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9cd95-9fce-41ad-a514-67aae6a782a7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:03.073917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-59a9cd95-9fce-41ad-a514-67aae6a782a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:03.157776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:03.161803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-05d99689-efa9-4fba-a9ef-552294ad57c4 None None] MFA Rules not processed for user `93dd89c1885846c2abed79bc32b340ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:03.168120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-05d99689-efa9-4fba-a9ef-552294ad57c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:03.284152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9cd95-9fce-41ad-a514-67aae6a782a7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:03.296890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:03.301932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:03.302333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:03.302655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] PATH_INFO: `/v3/projects/2d8fb4784673408c91aec93472ee475d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:03.307792 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8fb4784673408c91aec93472ee475d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:03.319927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:03.430098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 867/1713] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:03 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:03.445110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d99689-efa9-4fba-a9ef-552294ad57c4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:03.446680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-05d99689-efa9-4fba-a9ef-552294ad57c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:03.544453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8fb4784673408c91aec93472ee475d', 'request_id': 'req-ec6eaca6-abba-4aa2-9002-9df583d64b68'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:03.565185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8fb4784673408c91aec93472ee475d', 'request_id': 'req-ec6eaca6-abba-4aa2-9002-9df583d64b68'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:03.587909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8fb4784673408c91aec93472ee475d', 'request_id': 'req-ec6eaca6-abba-4aa2-9002-9df583d64b68'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:03.609575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d99689-efa9-4fba-a9ef-552294ad57c4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:03.689217 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] The token cache is being invalidate because project 2d8fb4784673408c91aec93472ee475d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:03.689529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:03.693852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:03.695454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 847/1714] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:03 2022] DELETE /identity/v3/projects/2d8fb4784673408c91aec93472ee475d => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:03.696292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:03.700041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:03.703767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a84ee8-c3d6-4864-86af-d2b5ce9ff7f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:03.709845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a84ee8-c3d6-4864-86af-d2b5ce9ff7f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:03.709845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a84ee8-c3d6-4864-86af-d2b5ce9ff7f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:03.709845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a84ee8-c3d6-4864-86af-d2b5ce9ff7f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:03.715442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-42a84ee8-c3d6-4864-86af-d2b5ce9ff7f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:03.897567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a84ee8-c3d6-4864-86af-d2b5ce9ff7f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:03.899071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a84ee8-c3d6-4864-86af-d2b5ce9ff7f7 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:03.909933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6eaca6-abba-4aa2-9002-9df583d64b68 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:03.932298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 868/1715] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:03 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:03.934156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16300fc9-bcbf-4280-a045-0e00447f6a03 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:03.934587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16300fc9-bcbf-4280-a045-0e00447f6a03 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:03.934858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16300fc9-bcbf-4280-a045-0e00447f6a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:03.938128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:03.938780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:03.939289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:03.939712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] PATH_INFO: `/v3/projects/1b603054e9b3455b91a11d98c1372d72` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:03.941240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b603054e9b3455b91a11d98c1372d72)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:03.943618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:03.997376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-16300fc9-bcbf-4280-a045-0e00447f6a03 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:03.997376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-16300fc9-bcbf-4280-a045-0e00447f6a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:04.029809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 869/1716] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:04.029809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec2c8-b94c-4471-a489-6bf8b5ec9b3e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:04.029809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec2c8-b94c-4471-a489-6bf8b5ec9b3e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:04.029809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ec2c8-b94c-4471-a489-6bf8b5ec9b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:04.165309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b603054e9b3455b91a11d98c1372d72', 'request_id': 'req-c8249d38-1c00-4ad2-8ea9-45765f804cfd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.166949 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d64ec2c8-b94c-4471-a489-6bf8b5ec9b3e None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:04.175334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d64ec2c8-b94c-4471-a489-6bf8b5ec9b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:04.214174 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b603054e9b3455b91a11d98c1372d72', 'request_id': 'req-c8249d38-1c00-4ad2-8ea9-45765f804cfd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.234334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b603054e9b3455b91a11d98c1372d72', 'request_id': 'req-c8249d38-1c00-4ad2-8ea9-45765f804cfd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.246998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:04.373134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] The token cache is being invalidate because project 1b603054e9b3455b91a11d98c1372d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:04.373443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.375444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c8249d38-1c00-4ad2-8ea9-45765f804cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.382238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 848/1717] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:03 2022] DELETE /identity/v3/projects/1b603054e9b3455b91a11d98c1372d72 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:04.383673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52049d7-dfca-4b3a-a827-41a96043245c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:04.383957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52049d7-dfca-4b3a-a827-41a96043245c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:04.384231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52049d7-dfca-4b3a-a827-41a96043245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:04.410100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 870/1718] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:03:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:04.411523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec2c8-b94c-4471-a489-6bf8b5ec9b3e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:04.412929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d64ec2c8-b94c-4471-a489-6bf8b5ec9b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:04.467216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:04.474961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e52049d7-dfca-4b3a-a827-41a96043245c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:04.479439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e52049d7-dfca-4b3a-a827-41a96043245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:04.646786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ec2c8-b94c-4471-a489-6bf8b5ec9b3e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:04.680623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:04.681292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:04.684785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:04.685122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] PATH_INFO: `/v3/users/11e83278ae4a4511879f2152ef0b22e6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:04.687205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e83278ae4a4511879f2152ef0b22e6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:04.695374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:04.695819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 849/1719] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:04.696710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52049d7-dfca-4b3a-a827-41a96043245c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:04.698331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e52049d7-dfca-4b3a-a827-41a96043245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:04.712838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52049d7-dfca-4b3a-a827-41a96043245c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:04.723097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:04.723766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:04.724042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:04.728438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] PATH_INFO: `/v3/users/bd05ab876c714c1b80cbddcb1532d08e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:04.728438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd05ab876c714c1b80cbddcb1532d08e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:04.728438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:04.931160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd05ab876c714c1b80cbddcb1532d08e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.945855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd05ab876c714c1b80cbddcb1532d08e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.949829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd05ab876c714c1b80cbddcb1532d08e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.952098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd05ab876c714c1b80cbddcb1532d08e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.974618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e83278ae4a4511879f2152ef0b22e6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.978243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e83278ae4a4511879f2152ef0b22e6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:04.980630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e83278ae4a4511879f2152ef0b22e6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:05.083542 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd05ab876c714c1b80cbddcb1532d08e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:05.128018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 850/1720] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:04 2022] DELETE /identity/v3/users/bd05ab876c714c1b80cbddcb1532d08e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:05.129518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:05.133492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:05.198308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e83278ae4a4511879f2152ef0b22e6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:05.226066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e83278ae4a4511879f2152ef0b22e6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:05.257324 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 871/1721] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:04 2022] DELETE /identity/v3/users/11e83278ae4a4511879f2152ef0b22e6 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:05.258367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:05.262820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:05.263350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223e3c1-5bb6-44f9-8673-3f04d9320e02 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:05.342301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:05.343716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:05.344359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:05.344832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:05.345933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:05.346487 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:05.348482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:05.373627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 851/1722] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:05.374915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:05.377544 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:05.390730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:05.395348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d060d-fc59-40e5-9ebb-50b4fa8aaac0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:05.401385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:05.403065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:05.403850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:05.404320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] PATH_INFO: `/v3/projects/145005f5805d45e99b83674e9380c7d1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:05.406546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145005f5805d45e99b83674e9380c7d1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:05.409086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:05.491869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b527f-f4de-4758-a321-868bfb76a2da admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:05.500747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c12343-3b97-478d-b08b-4af6154f0cea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:05.501936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c12343-3b97-478d-b08b-4af6154f0cea service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:05.502527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c12343-3b97-478d-b08b-4af6154f0cea service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:05.502994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c12343-3b97-478d-b08b-4af6154f0cea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:05.506600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a3c12343-3b97-478d-b08b-4af6154f0cea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:05.603311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145005f5805d45e99b83674e9380c7d1', 'request_id': 'req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:05.618633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145005f5805d45e99b83674e9380c7d1', 'request_id': 'req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:05.640093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145005f5805d45e99b83674e9380c7d1', 'request_id': 'req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:05.662045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c12343-3b97-478d-b08b-4af6154f0cea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:05.664493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c12343-3b97-478d-b08b-4af6154f0cea service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:05.677630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 872/1723] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:03:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:03:05.679431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901cb5-b7cf-4d2b-b14e-fdc92ab35f76 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:05.679823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901cb5-b7cf-4d2b-b14e-fdc92ab35f76 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:05.680172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901cb5-b7cf-4d2b-b14e-fdc92ab35f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:05.722186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:05.768033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-09901cb5-b7cf-4d2b-b14e-fdc92ab35f76 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:05.771765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-09901cb5-b7cf-4d2b-b14e-fdc92ab35f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:05.784029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] The token cache is being invalidate because project 145005f5805d45e99b83674e9380c7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:05.784327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:05.788417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:05.791546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 852/1724] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:05 2022] DELETE /identity/v3/projects/145005f5805d45e99b83674e9380c7d1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:05.808788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:05.817005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:06.064418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 873/1725] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:06.074421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b069ad-fc9c-431b-8647-b190bc46991c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:06.074421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b069ad-fc9c-431b-8647-b190bc46991c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:06.074421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b069ad-fc9c-431b-8647-b190bc46991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:06.154162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d7b069ad-fc9c-431b-8647-b190bc46991c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:06.159171 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d7b069ad-fc9c-431b-8647-b190bc46991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:06.205288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 874/1726] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:06.211433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b069ad-fc9c-431b-8647-b190bc46991c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:06.218246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d7b069ad-fc9c-431b-8647-b190bc46991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:06.220501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c8f84-45c8-43b2-9dd8-484ce2d8f3e7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:06.244800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a00115-0cd9-49ef-9a34-5da6ec30bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:06.258441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a00115-0cd9-49ef-9a34-5da6ec30bbad admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:06.260329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a00115-0cd9-49ef-9a34-5da6ec30bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:06.260675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a00115-0cd9-49ef-9a34-5da6ec30bbad admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:06.267431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a00115-0cd9-49ef-9a34-5da6ec30bbad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:06.275707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a00115-0cd9-49ef-9a34-5da6ec30bbad admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:06.411159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b069ad-fc9c-431b-8647-b190bc46991c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:06.415490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27baa088-702d-41ee-b593-96db7f972467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:06.416163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baa088-702d-41ee-b593-96db7f972467 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:06.418027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baa088-702d-41ee-b593-96db7f972467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:06.418372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baa088-702d-41ee-b593-96db7f972467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:06.434857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27baa088-702d-41ee-b593-96db7f972467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:06.436756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27baa088-702d-41ee-b593-96db7f972467 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:06.455542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 875/1727] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:06.458154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14e884-d9a6-4270-9dce-a7e9d789956e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:06.458556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14e884-d9a6-4270-9dce-a7e9d789956e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:06.459081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14e884-d9a6-4270-9dce-a7e9d789956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:06.571053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7e14e884-d9a6-4270-9dce-a7e9d789956e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:06.572444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7e14e884-d9a6-4270-9dce-a7e9d789956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:06.582513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 853/1728] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:05 2022] POST /identity/v3/projects => generated 375 bytes in 787 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:06.594729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a00115-0cd9-49ef-9a34-5da6ec30bbad admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:06.727019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:06.850964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 876/1729] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:06.854188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14e884-d9a6-4270-9dce-a7e9d789956e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:06.884328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14e884-d9a6-4270-9dce-a7e9d789956e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:06.891845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a00115-0cd9-49ef-9a34-5da6ec30bbad admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:06.924680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcddf4-9c53-4b70-a41c-263c5830c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:06.924944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcddf4-9c53-4b70-a41c-263c5830c1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:06.925178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcddf4-9c53-4b70-a41c-263c5830c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:06.925385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcddf4-9c53-4b70-a41c-263c5830c1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:06.926069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcddf4-9c53-4b70-a41c-263c5830c1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:06.929087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcddf4-9c53-4b70-a41c-263c5830c1c7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:06.938387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bded9-da7c-41a6-9050-5f561606d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:06.940780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bded9-da7c-41a6-9050-5f561606d1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:06.941876 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bded9-da7c-41a6-9050-5f561606d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:06.942880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bded9-da7c-41a6-9050-5f561606d1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:06.946394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bded9-da7c-41a6-9050-5f561606d1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:06.949326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bded9-da7c-41a6-9050-5f561606d1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:06.960380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bded9-da7c-41a6-9050-5f561606d1ae admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:06.994553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 877/1730] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:06.996919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bded9-da7c-41a6-9050-5f561606d1ae admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:07.045646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bded9-da7c-41a6-9050-5f561606d1ae admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:07.082278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b12c9c-a1cd-497a-ae45-9434a2097377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:07.083137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 854/1731] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:06 2022] POST /identity/v3/users => generated 288 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:07.083713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcddf4-9c53-4b70-a41c-263c5830c1c7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:07.085278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b12c9c-a1cd-497a-ae45-9434a2097377 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:07.087986 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b12c9c-a1cd-497a-ae45-9434a2097377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:07.092943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b12c9c-a1cd-497a-ae45-9434a2097377 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:07.096207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b12c9c-a1cd-497a-ae45-9434a2097377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:07.103874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcddf4-9c53-4b70-a41c-263c5830c1c7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:07.108399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b12c9c-a1cd-497a-ae45-9434a2097377 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:07.118300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33410b2f-a038-4d73-be3c-7ad94271103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:07.119203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33410b2f-a038-4d73-be3c-7ad94271103f admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:07.119674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33410b2f-a038-4d73-be3c-7ad94271103f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:07.120090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33410b2f-a038-4d73-be3c-7ad94271103f admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:07.121457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33410b2f-a038-4d73-be3c-7ad94271103f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:07.123362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33410b2f-a038-4d73-be3c-7ad94271103f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:07.148753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 855/1732] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:07.150521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33410b2f-a038-4d73-be3c-7ad94271103f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:07.155745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-33410b2f-a038-4d73-be3c-7ad94271103f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:07.212644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33410b2f-a038-4d73-be3c-7ad94271103f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:07.232900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 878/1733] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:06 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:07.235091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b12c9c-a1cd-497a-ae45-9434a2097377 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:07.243687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:07.244344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:07.261673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:07.261673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] PATH_INFO: `/v3/projects/230870a4bf4342e695643a7b64f79fc7` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:07.261673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] RBAC: Authorizing `identity:delete_project(project_id=230870a4bf4342e695643a7b64f79fc7)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:07.261673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:07.419558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b12c9c-a1cd-497a-ae45-9434a2097377 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:07.426925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764e19e-1fc6-4b26-a682-55c3f039957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:07.428940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e19e-1fc6-4b26-a682-55c3f039957d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:07.429821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e19e-1fc6-4b26-a682-55c3f039957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:07.430250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e19e-1fc6-4b26-a682-55c3f039957d admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:07.431234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764e19e-1fc6-4b26-a682-55c3f039957d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:07.433290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764e19e-1fc6-4b26-a682-55c3f039957d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:07.456815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 879/1734] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:07.458209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764e19e-1fc6-4b26-a682-55c3f039957d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:07.475773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764e19e-1fc6-4b26-a682-55c3f039957d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:07.531877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230870a4bf4342e695643a7b64f79fc7', 'request_id': 'req-559e8984-48a2-40c4-9953-d046e4a0266c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:07.546669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230870a4bf4342e695643a7b64f79fc7', 'request_id': 'req-559e8984-48a2-40c4-9953-d046e4a0266c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:07.560285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230870a4bf4342e695643a7b64f79fc7', 'request_id': 'req-559e8984-48a2-40c4-9953-d046e4a0266c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:07.642079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dbaf2-56e6-406d-8b3f-24c1f949f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:07.647433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dbaf2-56e6-406d-8b3f-24c1f949f2ce admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:07.647433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dbaf2-56e6-406d-8b3f-24c1f949f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:07.647433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dbaf2-56e6-406d-8b3f-24c1f949f2ce admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:07.647433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dbaf2-56e6-406d-8b3f-24c1f949f2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:07.652181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dbaf2-56e6-406d-8b3f-24c1f949f2ce admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:07.673813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] The token cache is being invalidate because project 230870a4bf4342e695643a7b64f79fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:07.674509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:07.675629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:07.679387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 856/1735] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:07 2022] DELETE /identity/v3/projects/230870a4bf4342e695643a7b64f79fc7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:07.680991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:07.685329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:07.712047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8984-48a2-40c4-9953-d046e4a0266c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:07.733435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9512edc-6332-4226-832e-22fb605e4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:07.737032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512edc-6332-4226-832e-22fb605e4c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:07.741661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512edc-6332-4226-832e-22fb605e4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:07.741933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512edc-6332-4226-832e-22fb605e4c0d admin admin] PATH_INFO: `/v3/projects/20af047259104c09ac43c45dc7dba4ce/users/1e9b2e05074e4e189726c0f319475e19/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:07.808891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9512edc-6332-4226-832e-22fb605e4c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20af047259104c09ac43c45dc7dba4ce, user_id=1e9b2e05074e4e189726c0f319475e19, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:07.818903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9512edc-6332-4226-832e-22fb605e4c0d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:07.819025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 880/1736] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:07 2022] POST /identity/v3/users => generated 291 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:07.819025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfc66f-a38f-49be-95d7-58ccc21522a4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:07.819025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfc66f-a38f-49be-95d7-58ccc21522a4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:07.819025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfc66f-a38f-49be-95d7-58ccc21522a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:07.867356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-91dfc66f-a38f-49be-95d7-58ccc21522a4 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:07.873658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-91dfc66f-a38f-49be-95d7-58ccc21522a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:07.912982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 881/1737] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:07.912982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfc66f-a38f-49be-95d7-58ccc21522a4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:07.912982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-91dfc66f-a38f-49be-95d7-58ccc21522a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:07.937692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfc66f-a38f-49be-95d7-58ccc21522a4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:07.962882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 857/1738] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:07 2022] PUT /identity/v3/projects/20af047259104c09ac43c45dc7dba4ce/users/1e9b2e05074e4e189726c0f319475e19/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:07.965796 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97f51e-2187-4460-a0d7-30f79c350f4e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:07.968561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97f51e-2187-4460-a0d7-30f79c350f4e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:07.969322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97f51e-2187-4460-a0d7-30f79c350f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:07.975588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09239b7-e82d-409f-8d69-34e894435fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:07.977022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09239b7-e82d-409f-8d69-34e894435fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:07.979999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09239b7-e82d-409f-8d69-34e894435fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:07.980711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09239b7-e82d-409f-8d69-34e894435fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:07.981071 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:07.981996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09239b7-e82d-409f-8d69-34e894435fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:07.990007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09239b7-e82d-409f-8d69-34e894435fb2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:08.023978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:08.039469 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 882/1739] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:08.046490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458151c-41a8-484a-ab13-57d63a083182 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:08.049231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458151c-41a8-484a-ab13-57d63a083182 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:08.050474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458151c-41a8-484a-ab13-57d63a083182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:08.054732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5b97f51e-2187-4460-a0d7-30f79c350f4e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:08.055970 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5b97f51e-2187-4460-a0d7-30f79c350f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:08.151691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b458151c-41a8-484a-ab13-57d63a083182 None None] MFA Rules not processed for user `1e9b2e05074e4e189726c0f319475e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:08.155894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b458151c-41a8-484a-ab13-57d63a083182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:08.280561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 858/1740] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:08.285329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18b86-baad-4ca3-9ffd-740af82bd287 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:08.299259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18b86-baad-4ca3-9ffd-740af82bd287 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:08.299604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18b86-baad-4ca3-9ffd-740af82bd287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:08.351647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2ff18b86-baad-4ca3-9ffd-740af82bd287 None None] MFA Rules not processed for user `321d07f93b7540128dc5415d8b3252c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:08.353170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2ff18b86-baad-4ca3-9ffd-740af82bd287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:08.373703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 883/1741] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:08.377840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458151c-41a8-484a-ab13-57d63a083182 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:08.407969 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458151c-41a8-484a-ab13-57d63a083182 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:08.420448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7b2cc-acf1-4f22-91f2-bccba89c2fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:08.421264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7b2cc-acf1-4f22-91f2-bccba89c2fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:08.422734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7b2cc-acf1-4f22-91f2-bccba89c2fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:08.423126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7b2cc-acf1-4f22-91f2-bccba89c2fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:08.423948 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7b2cc-acf1-4f22-91f2-bccba89c2fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:08.434472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7b2cc-acf1-4f22-91f2-bccba89c2fe7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:08.482381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 884/1742] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:08.482381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7b2cc-acf1-4f22-91f2-bccba89c2fe7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:08.504572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7b2cc-acf1-4f22-91f2-bccba89c2fe7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:08.523312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d271c5b-c891-4142-9804-7638a6562b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:08.523858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271c5b-c891-4142-9804-7638a6562b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:08.524152 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271c5b-c891-4142-9804-7638a6562b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:08.524431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271c5b-c891-4142-9804-7638a6562b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:08.525112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d271c5b-c891-4142-9804-7638a6562b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:08.525415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d271c5b-c891-4142-9804-7638a6562b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:08.527915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d271c5b-c891-4142-9804-7638a6562b0b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:08.541023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 859/1743] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 24 08:03:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:08.544190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db76a12-325c-4eb4-93bd-99d5d32ea8c3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:08.544190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db76a12-325c-4eb4-93bd-99d5d32ea8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:08.544190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db76a12-325c-4eb4-93bd-99d5d32ea8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:08.580630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 885/1744] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:08.580841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d271c5b-c891-4142-9804-7638a6562b0b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:08.593773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7db76a12-325c-4eb4-93bd-99d5d32ea8c3 None None] MFA Rules not processed for user `9870363844644da7ad0a353f8ebfeffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:08.597444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7db76a12-325c-4eb4-93bd-99d5d32ea8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:08.606852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d271c5b-c891-4142-9804-7638a6562b0b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:08.633721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213c11c-68f4-4b67-b254-ba1978509f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:08.634286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213c11c-68f4-4b67-b254-ba1978509f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:08.634724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213c11c-68f4-4b67-b254-ba1978509f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:08.634999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213c11c-68f4-4b67-b254-ba1978509f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:08.635647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213c11c-68f4-4b67-b254-ba1978509f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:08.641305 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213c11c-68f4-4b67-b254-ba1978509f95 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:08.712204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 860/1745] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:08.712204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db76a12-325c-4eb4-93bd-99d5d32ea8c3 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:08.721874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db76a12-325c-4eb4-93bd-99d5d32ea8c3 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:08.728861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813e09-866d-4123-b619-2acd3edf0752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:08.732306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813e09-866d-4123-b619-2acd3edf0752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:08.732306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813e09-866d-4123-b619-2acd3edf0752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:08.732306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813e09-866d-4123-b619-2acd3edf0752 admin admin] PATH_INFO: `/v3/projects/c28e54653b1e4e8eb761f2c8868537d6/users/575597aa1b69435e81963d3bb3a484a5/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:08.751709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35813e09-866d-4123-b619-2acd3edf0752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28e54653b1e4e8eb761f2c8868537d6, user_id=575597aa1b69435e81963d3bb3a484a5, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:08.755314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35813e09-866d-4123-b619-2acd3edf0752 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:08.840510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 886/1746] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:08 2022] POST /identity/v3/projects => generated 377 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:08.845017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213c11c-68f4-4b67-b254-ba1978509f95 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:08.860917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 861/1747] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:08 2022] PUT /identity/v3/projects/c28e54653b1e4e8eb761f2c8868537d6/users/575597aa1b69435e81963d3bb3a484a5/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:08.862496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813e09-866d-4123-b619-2acd3edf0752 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:08.874427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-35813e09-866d-4123-b619-2acd3edf0752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:08.968852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213c11c-68f4-4b67-b254-ba1978509f95 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:09.077344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813e09-866d-4123-b619-2acd3edf0752 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:09.086139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d5a7c-fe57-4724-86bf-07c882cb2962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:09.086139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d5a7c-fe57-4724-86bf-07c882cb2962 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.086139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d5a7c-fe57-4724-86bf-07c882cb2962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.086139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d5a7c-fe57-4724-86bf-07c882cb2962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.109880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d5a7c-fe57-4724-86bf-07c882cb2962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:09.111473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d5a7c-fe57-4724-86bf-07c882cb2962 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:09.116177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934bea6-98d4-449e-b7a7-4ab00aa60896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:09.116915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934bea6-98d4-449e-b7a7-4ab00aa60896 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.117267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934bea6-98d4-449e-b7a7-4ab00aa60896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.128150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934bea6-98d4-449e-b7a7-4ab00aa60896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.129889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934bea6-98d4-449e-b7a7-4ab00aa60896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:09.133561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934bea6-98d4-449e-b7a7-4ab00aa60896 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:09.146585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:09.154797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 862/1748] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:09.154797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d5a7c-fe57-4724-86bf-07c882cb2962 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:09.181020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d5a7c-fe57-4724-86bf-07c882cb2962 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:09.190346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7539cb9-22f1-40fb-8198-c218ba133a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:09.191311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7539cb9-22f1-40fb-8198-c218ba133a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.191735 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7539cb9-22f1-40fb-8198-c218ba133a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.192153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7539cb9-22f1-40fb-8198-c218ba133a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.208145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:09.215569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7539cb9-22f1-40fb-8198-c218ba133a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:09.217271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7539cb9-22f1-40fb-8198-c218ba133a05 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:09.238992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 863/1749] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:09.242740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7539cb9-22f1-40fb-8198-c218ba133a05 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:09.282576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 887/1750] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:08 2022] POST /identity/v3/projects => generated 383 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:09.282576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07715-5ab4-4469-8659-512e009f6eaa None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.282576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07715-5ab4-4469-8659-512e009f6eaa None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.282576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c07715-5ab4-4469-8659-512e009f6eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.293022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7539cb9-22f1-40fb-8198-c218ba133a05 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:09.374565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e9c07715-5ab4-4469-8659-512e009f6eaa None None] MFA Rules not processed for user `575597aa1b69435e81963d3bb3a484a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:09.375919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e9c07715-5ab4-4469-8659-512e009f6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:09.424389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a18b67-71f3-4701-8ec8-8cb5a1646039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:09.427318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a18b67-71f3-4701-8ec8-8cb5a1646039 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.428283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a18b67-71f3-4701-8ec8-8cb5a1646039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.429049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a18b67-71f3-4701-8ec8-8cb5a1646039 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.430034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a18b67-71f3-4701-8ec8-8cb5a1646039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:09.435299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a18b67-71f3-4701-8ec8-8cb5a1646039 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:09.541291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 864/1751] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:09 2022] POST /identity/v3/users => generated 295 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:09.541291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a18b67-71f3-4701-8ec8-8cb5a1646039 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:09.555604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:09.560710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 888/1752] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:09.564669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c07715-5ab4-4469-8659-512e009f6eaa None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:09.584393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a18b67-71f3-4701-8ec8-8cb5a1646039 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:09.601716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36dad-c5a3-426f-babc-645339c5881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:09.603130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36dad-c5a3-426f-babc-645339c5881c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.603836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36dad-c5a3-426f-babc-645339c5881c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.605870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c07715-5ab4-4469-8659-512e009f6eaa None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:09.606018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:09.606619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36dad-c5a3-426f-babc-645339c5881c admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.607316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36dad-c5a3-426f-babc-645339c5881c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:09.610506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36dad-c5a3-426f-babc-645339c5881c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:09.616846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b275-43f9-45fe-b301-9bd6a779b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:09.616846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b275-43f9-45fe-b301-9bd6a779b25b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.616846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b275-43f9-45fe-b301-9bd6a779b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.616846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b275-43f9-45fe-b301-9bd6a779b25b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.617209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5b275-43f9-45fe-b301-9bd6a779b25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:09.617209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5b275-43f9-45fe-b301-9bd6a779b25b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:09.632737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 889/1753] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:09.633721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b275-43f9-45fe-b301-9bd6a779b25b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:09.650212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b275-43f9-45fe-b301-9bd6a779b25b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:09.656265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d1991-45d8-4a64-a471-de5c42001e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:09.656950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1991-45d8-4a64-a471-de5c42001e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.663447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1991-45d8-4a64-a471-de5c42001e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.663447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1991-45d8-4a64-a471-de5c42001e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.663447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d1991-45d8-4a64-a471-de5c42001e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:09.663447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d1991-45d8-4a64-a471-de5c42001e77 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:09.758785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 865/1754] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:09 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:09.758785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36dad-c5a3-426f-babc-645339c5881c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:09.810934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 890/1755] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:09 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:09.812001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d1991-45d8-4a64-a471-de5c42001e77 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:09.839249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36dad-c5a3-426f-babc-645339c5881c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.039220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2429e48-d91b-40b8-9bdc-0855f02b3163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.039965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2429e48-d91b-40b8-9bdc-0855f02b3163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.040481 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2429e48-d91b-40b8-9bdc-0855f02b3163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.040758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2429e48-d91b-40b8-9bdc-0855f02b3163 admin admin] PATH_INFO: `/v3/projects/64f9732f5f92418ab9aeaa09b5ea4ce8/users/733a58387db64ef28fda170367c6c1c3/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.069525 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d1991-45d8-4a64-a471-de5c42001e77 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.097344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2cb0a-3905-4c37-a37b-3270b423c431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.098082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2cb0a-3905-4c37-a37b-3270b423c431 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.098357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2cb0a-3905-4c37-a37b-3270b423c431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.098879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2cb0a-3905-4c37-a37b-3270b423c431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.099933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2cb0a-3905-4c37-a37b-3270b423c431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.103971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2cb0a-3905-4c37-a37b-3270b423c431 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.113326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2429e48-d91b-40b8-9bdc-0855f02b3163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f9732f5f92418ab9aeaa09b5ea4ce8, user_id=733a58387db64ef28fda170367c6c1c3, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.117059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2429e48-d91b-40b8-9bdc-0855f02b3163 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.141664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 891/1756] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:10.145430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2cb0a-3905-4c37-a37b-3270b423c431 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:10.164534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2cb0a-3905-4c37-a37b-3270b423c431 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.179693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdc190-e0be-4ea5-a7eb-62f2384b891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.180657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdc190-e0be-4ea5-a7eb-62f2384b891d admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.180942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdc190-e0be-4ea5-a7eb-62f2384b891d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.181230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdc190-e0be-4ea5-a7eb-62f2384b891d admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.182022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdc190-e0be-4ea5-a7eb-62f2384b891d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.186041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdc190-e0be-4ea5-a7eb-62f2384b891d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.358840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 892/1757] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:10 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:10.369538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 866/1758] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:09 2022] PUT /identity/v3/projects/64f9732f5f92418ab9aeaa09b5ea4ce8/users/733a58387db64ef28fda170367c6c1c3/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:10.369758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdc190-e0be-4ea5-a7eb-62f2384b891d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:10.373436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2429e48-d91b-40b8-9bdc-0855f02b3163 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:10.386309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:10.397879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdc190-e0be-4ea5-a7eb-62f2384b891d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.559916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354631a-ef8c-4fbb-b5b2-f6dfab59a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.560553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354631a-ef8c-4fbb-b5b2-f6dfab59a685 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.560843 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354631a-ef8c-4fbb-b5b2-f6dfab59a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.561157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354631a-ef8c-4fbb-b5b2-f6dfab59a685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.561861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354631a-ef8c-4fbb-b5b2-f6dfab59a685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.562049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2429e48-d91b-40b8-9bdc-0855f02b3163 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.563482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354631a-ef8c-4fbb-b5b2-f6dfab59a685 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.579402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b0254-0b62-4c16-8f6a-4c8a2812253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.583276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b0254-0b62-4c16-8f6a-4c8a2812253f admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.583276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b0254-0b62-4c16-8f6a-4c8a2812253f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.583276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b0254-0b62-4c16-8f6a-4c8a2812253f admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.587084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b0254-0b62-4c16-8f6a-4c8a2812253f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.589247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 893/1759] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:10.590264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354631a-ef8c-4fbb-b5b2-f6dfab59a685 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:10.591728 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b0254-0b62-4c16-8f6a-4c8a2812253f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.612577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354631a-ef8c-4fbb-b5b2-f6dfab59a685 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.625958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb5a7a-d801-4379-b72e-6c6c548da041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.626596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb5a7a-d801-4379-b72e-6c6c548da041 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.626879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb5a7a-d801-4379-b72e-6c6c548da041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.627150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb5a7a-d801-4379-b72e-6c6c548da041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.627825 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb5a7a-d801-4379-b72e-6c6c548da041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.629711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb5a7a-d801-4379-b72e-6c6c548da041 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.634527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 867/1760] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:10.637646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b0254-0b62-4c16-8f6a-4c8a2812253f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:10.664540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b0254-0b62-4c16-8f6a-4c8a2812253f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.672279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca085c-713d-4749-b639-b16ef4402538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.672977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca085c-713d-4749-b639-b16ef4402538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.678169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca085c-713d-4749-b639-b16ef4402538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.678741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca085c-713d-4749-b639-b16ef4402538 admin admin] PATH_INFO: `/v3/projects/eedb90120d344780bbc030559d62722e/users/e55a2a650ab34b269c70220626a05506/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.711409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 894/1761] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:10.714754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb5a7a-d801-4379-b72e-6c6c548da041 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:10.767833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb5a7a-d801-4379-b72e-6c6c548da041 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:10.779349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f06f0-1bfc-4c06-ae5e-4e120aeee66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:10.780850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f06f0-1bfc-4c06-ae5e-4e120aeee66e admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.780850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f06f0-1bfc-4c06-ae5e-4e120aeee66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.788350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f06f0-1bfc-4c06-ae5e-4e120aeee66e admin admin] PATH_INFO: `/v3/projects/b9ce2596d72c408493c92854842d1d79/users/63d1999f69104ef3995d9a95dcbabc42/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.803801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca085c-713d-4749-b639-b16ef4402538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedb90120d344780bbc030559d62722e, user_id=e55a2a650ab34b269c70220626a05506, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.806744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca085c-713d-4749-b639-b16ef4402538 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.826441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f06f0-1bfc-4c06-ae5e-4e120aeee66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ce2596d72c408493c92854842d1d79, user_id=63d1999f69104ef3995d9a95dcbabc42, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.855155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f06f0-1bfc-4c06-ae5e-4e120aeee66e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.903519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 868/1762] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:10 2022] PUT /identity/v3/projects/eedb90120d344780bbc030559d62722e/users/e55a2a650ab34b269c70220626a05506/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:10.904957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca085c-713d-4749-b639-b16ef4402538 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:10.953634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 895/1763] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:10 2022] PUT /identity/v3/projects/b9ce2596d72c408493c92854842d1d79/users/63d1999f69104ef3995d9a95dcbabc42/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:10.955157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6c4c6-1e09-49eb-b214-770818834799 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:10.955437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6c4c6-1e09-49eb-b214-770818834799 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:10.955708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6c4c6-1e09-49eb-b214-770818834799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:10.969642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:11.056368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-46d6c4c6-1e09-49eb-b214-770818834799 None None] MFA Rules not processed for user `e55a2a650ab34b269c70220626a05506`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:11.056671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-46d6c4c6-1e09-49eb-b214-770818834799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:11.069338 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca085c-713d-4749-b639-b16ef4402538 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:11.163795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:11.273656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276df5-fb9c-46fb-8845-437884e7a236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:11.274376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276df5-fb9c-46fb-8845-437884e7a236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:11.274602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276df5-fb9c-46fb-8845-437884e7a236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:11.274880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276df5-fb9c-46fb-8845-437884e7a236 admin admin] PATH_INFO: `/v3/projects/64f9732f5f92418ab9aeaa09b5ea4ce8/users/733a58387db64ef28fda170367c6c1c3/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:11.281070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276df5-fb9c-46fb-8845-437884e7a236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f9732f5f92418ab9aeaa09b5ea4ce8, user_id=733a58387db64ef28fda170367c6c1c3, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:11.284085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276df5-fb9c-46fb-8845-437884e7a236 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:11.322824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 869/1764] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:10 2022] PUT /identity/v3/projects/64f9732f5f92418ab9aeaa09b5ea4ce8/users/733a58387db64ef28fda170367c6c1c3/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:11.324210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276df5-fb9c-46fb-8845-437884e7a236 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:11.342771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 896/1765] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:11.346582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6c4c6-1e09-49eb-b214-770818834799 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:11.349870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-46d6c4c6-1e09-49eb-b214-770818834799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:11.387956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6c4c6-1e09-49eb-b214-770818834799 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:11.516752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:11.517562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:11.517962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:11.518290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] PATH_INFO: `/v3/projects/2c1d1d79bc7b48f4942aef8315f4d05e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:11.519680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1d1d79bc7b48f4942aef8315f4d05e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:11.539981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:11.550453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276df5-fb9c-46fb-8845-437884e7a236 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:11.569383 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29019d1-8281-46e1-822f-c71f73239228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:11.573683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29019d1-8281-46e1-822f-c71f73239228 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:11.573683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29019d1-8281-46e1-822f-c71f73239228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:11.573683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29019d1-8281-46e1-822f-c71f73239228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:11.573683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29019d1-8281-46e1-822f-c71f73239228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:11.579942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29019d1-8281-46e1-822f-c71f73239228 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:11.617930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 870/1766] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:11.623139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f041e7-ec2e-4ac4-9b57-ce47c9d0a802 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:11.625302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f041e7-ec2e-4ac4-9b57-ce47c9d0a802 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:11.626084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f041e7-ec2e-4ac4-9b57-ce47c9d0a802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:11.662581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:11.826599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1d1d79bc7b48f4942aef8315f4d05e', 'request_id': 'req-50825038-9336-442b-a1d3-24fb9da744ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.831052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-19f041e7-ec2e-4ac4-9b57-ce47c9d0a802 None None] MFA Rules not processed for user `733a58387db64ef28fda170367c6c1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:11.832780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-19f041e7-ec2e-4ac4-9b57-ce47c9d0a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:11.840550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1d1d79bc7b48f4942aef8315f4d05e', 'request_id': 'req-50825038-9336-442b-a1d3-24fb9da744ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.855281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1d1d79bc7b48f4942aef8315f4d05e', 'request_id': 'req-50825038-9336-442b-a1d3-24fb9da744ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.957549 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] The token cache is being invalidate because project 2c1d1d79bc7b48f4942aef8315f4d05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:11.957900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.959064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:11.962563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 897/1767] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:11 2022] DELETE /identity/v3/projects/2c1d1d79bc7b48f4942aef8315f4d05e => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:11.962911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:11.985446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.092520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 871/1768] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:12.095986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f041e7-ec2e-4ac4-9b57-ce47c9d0a802 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:12.104172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-19f041e7-ec2e-4ac4-9b57-ce47c9d0a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.135789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:12.173911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50825038-9336-442b-a1d3-24fb9da744ca admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:12.186699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f0bf-5221-4214-8f9c-cac4b2dfe016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:12.188520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f0bf-5221-4214-8f9c-cac4b2dfe016 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:12.188801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f0bf-5221-4214-8f9c-cac4b2dfe016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:12.189073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f0bf-5221-4214-8f9c-cac4b2dfe016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:12.191868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f0bf-5221-4214-8f9c-cac4b2dfe016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:12.196309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f0bf-5221-4214-8f9c-cac4b2dfe016 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:12.272077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f041e7-ec2e-4ac4-9b57-ce47c9d0a802 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:12.278197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25651c8-2171-4247-80a3-3d6159094310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:12.278804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25651c8-2171-4247-80a3-3d6159094310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:12.279086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25651c8-2171-4247-80a3-3d6159094310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:12.279360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25651c8-2171-4247-80a3-3d6159094310 admin admin] PATH_INFO: `/v3/projects/b9ce2596d72c408493c92854842d1d79/users/63d1999f69104ef3995d9a95dcbabc42/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:12.293874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25651c8-2171-4247-80a3-3d6159094310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ce2596d72c408493c92854842d1d79, user_id=63d1999f69104ef3995d9a95dcbabc42, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:12.296941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25651c8-2171-4247-80a3-3d6159094310 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:12.324698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 898/1769] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:11 2022] POST /identity/v3/projects => generated 383 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:12.324698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f0bf-5221-4214-8f9c-cac4b2dfe016 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:12.328318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 872/1770] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:12 2022] PUT /identity/v3/projects/b9ce2596d72c408493c92854842d1d79/users/63d1999f69104ef3995d9a95dcbabc42/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:12.328318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25651c8-2171-4247-80a3-3d6159094310 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:12.328564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f4e0f0bf-5221-4214-8f9c-cac4b2dfe016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.346479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c25651c8-2171-4247-80a3-3d6159094310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.586056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f0bf-5221-4214-8f9c-cac4b2dfe016 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:12.590628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25651c8-2171-4247-80a3-3d6159094310 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:12.608026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:12.608753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:12.612143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:12.612444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] PATH_INFO: `/v3/users/93dd89c1885846c2abed79bc32b340ca` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:12.618451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93dd89c1885846c2abed79bc32b340ca)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:12.623836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:12.711632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:12.729037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddc5b8-0b81-4512-861f-b36cec4ca3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:12.730278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddc5b8-0b81-4512-861f-b36cec4ca3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:12.730589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddc5b8-0b81-4512-861f-b36cec4ca3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:12.730934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddc5b8-0b81-4512-861f-b36cec4ca3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:12.744591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2eddc5b8-0b81-4512-861f-b36cec4ca3d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.910020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93dd89c1885846c2abed79bc32b340ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:12.915722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93dd89c1885846c2abed79bc32b340ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:12.917869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93dd89c1885846c2abed79bc32b340ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:12.980422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93dd89c1885846c2abed79bc32b340ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:12.980883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddc5b8-0b81-4512-861f-b36cec4ca3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:12.985355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddc5b8-0b81-4512-861f-b36cec4ca3d6 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:13.001892 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 873/1771] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:13.004665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddc5b8-0b81-4512-861f-b36cec4ca3d6 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:13.011554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7161a9c9-2753-4ecf-8c2a-e085f3f9fde8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93dd89c1885846c2abed79bc32b340ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:13.022394 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddc5b8-0b81-4512-861f-b36cec4ca3d6 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:13.031183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb75f9-0181-4724-bf6a-de64eddbb35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:13.032176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb75f9-0181-4724-bf6a-de64eddbb35d admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.032692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb75f9-0181-4724-bf6a-de64eddbb35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.033155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb75f9-0181-4724-bf6a-de64eddbb35d admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.034280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb75f9-0181-4724-bf6a-de64eddbb35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:13.038233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb75f9-0181-4724-bf6a-de64eddbb35d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:13.063080 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 899/1772] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:12 2022] DELETE /identity/v3/users/93dd89c1885846c2abed79bc32b340ca => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:13.069917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaeaff-36e9-41cd-850a-f41604723da7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.070697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaeaff-36e9-41cd-850a-f41604723da7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.075463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaeaff-36e9-41cd-850a-f41604723da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.124169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 874/1773] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:13 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:13.126324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c693c3-ef5e-4314-965c-f932b111fe32 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.126881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c693c3-ef5e-4314-965c-f932b111fe32 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.127406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c693c3-ef5e-4314-965c-f932b111fe32 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.133708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 875/1774] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:03:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:13.134635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c693c3-ef5e-4314-965c-f932b111fe32 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:13.153297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-15c693c3-ef5e-4314-965c-f932b111fe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:13.198159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6cfaeaff-36e9-41cd-850a-f41604723da7 None None] MFA Rules not processed for user `63d1999f69104ef3995d9a95dcbabc42`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:13.203244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6cfaeaff-36e9-41cd-850a-f41604723da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:13.374330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c693c3-ef5e-4314-965c-f932b111fe32 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:13.385264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5abe4-e3e6-4b38-a9ed-4a88c35e4b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:13.386366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5abe4-e3e6-4b38-a9ed-4a88c35e4b98 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.386932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5abe4-e3e6-4b38-a9ed-4a88c35e4b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.387116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5abe4-e3e6-4b38-a9ed-4a88c35e4b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.389795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5abe4-e3e6-4b38-a9ed-4a88c35e4b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:13.396177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5abe4-e3e6-4b38-a9ed-4a88c35e4b98 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:13.410610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 900/1775] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:13.412172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78693bb-c860-47ce-94a7-5ab3870d4190 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.412454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78693bb-c860-47ce-94a7-5ab3870d4190 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.413053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78693bb-c860-47ce-94a7-5ab3870d4190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.420968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 876/1776] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:13.430391 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5abe4-e3e6-4b38-a9ed-4a88c35e4b98 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:13.448515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5abe4-e3e6-4b38-a9ed-4a88c35e4b98 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:13.460211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104f4d0-2e8d-4196-a34f-ce8ef328fd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:13.460943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104f4d0-2e8d-4196-a34f-ce8ef328fd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.461261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104f4d0-2e8d-4196-a34f-ce8ef328fd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.461549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104f4d0-2e8d-4196-a34f-ce8ef328fd20 admin admin] PATH_INFO: `/v3/projects/816495355a984e87a758ce48fee368fe/users/1f6bcdaae5044da7aff3722e2666fb0a/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.479983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a78693bb-c860-47ce-94a7-5ab3870d4190 None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:13.482482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a78693bb-c860-47ce-94a7-5ab3870d4190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:13.514517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104f4d0-2e8d-4196-a34f-ce8ef328fd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816495355a984e87a758ce48fee368fe, user_id=1f6bcdaae5044da7aff3722e2666fb0a, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:13.518736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104f4d0-2e8d-4196-a34f-ce8ef328fd20 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:13.587349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 877/1777] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:13 2022] PUT /identity/v3/projects/816495355a984e87a758ce48fee368fe/users/1f6bcdaae5044da7aff3722e2666fb0a/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:13.588538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104f4d0-2e8d-4196-a34f-ce8ef328fd20 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:13.591427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5104f4d0-2e8d-4196-a34f-ce8ef328fd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:13.717140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 901/1778] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:03:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:13.719414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4e200-b6da-4eca-97f0-9b9c6a61a45a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.722070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4e200-b6da-4eca-97f0-9b9c6a61a45a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.722070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4e200-b6da-4eca-97f0-9b9c6a61a45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.722281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:13.757845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104f4d0-2e8d-4196-a34f-ce8ef328fd20 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:13.763638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-bff4e200-b6da-4eca-97f0-9b9c6a61a45a None None] MFA Rules not processed for user `145c02717fc04c4aa81829de41470262`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:13.765410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bff4e200-b6da-4eca-97f0-9b9c6a61a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:13.768085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976522c-d7c9-4755-a83b-8be013df870b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:13.768868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976522c-d7c9-4755-a83b-8be013df870b service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:13.769340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976522c-d7c9-4755-a83b-8be013df870b service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:13.769741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976522c-d7c9-4755-a83b-8be013df870b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:13.788497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:13.913565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976522c-d7c9-4755-a83b-8be013df870b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:13.915254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976522c-d7c9-4755-a83b-8be013df870b service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:13.939634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 878/1779] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:13.944600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976522c-d7c9-4755-a83b-8be013df870b service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:14.066960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 902/1780] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:14.068286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4e200-b6da-4eca-97f0-9b9c6a61a45a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:14.070292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bff4e200-b6da-4eca-97f0-9b9c6a61a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:14.171814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976522c-d7c9-4755-a83b-8be013df870b service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:14.199718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e8c2f-789b-42bf-b819-802139a7e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:14.200539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e8c2f-789b-42bf-b819-802139a7e047 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:14.227931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e8c2f-789b-42bf-b819-802139a7e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:14.227931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e8c2f-789b-42bf-b819-802139a7e047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:14.227931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e8c2f-789b-42bf-b819-802139a7e047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:14.227931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e8c2f-789b-42bf-b819-802139a7e047 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:14.259887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 879/1781] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:14.261348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e8c2f-789b-42bf-b819-802139a7e047 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:14.275079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e8c2f-789b-42bf-b819-802139a7e047 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:14.282507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1cb7a-c986-45c7-8b01-3c633b2e2e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:14.283531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1cb7a-c986-45c7-8b01-3c633b2e2e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:14.284659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1cb7a-c986-45c7-8b01-3c633b2e2e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:14.285178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1cb7a-c986-45c7-8b01-3c633b2e2e3c admin admin] PATH_INFO: `/v3/projects/816495355a984e87a758ce48fee368fe/users/1f6bcdaae5044da7aff3722e2666fb0a/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:14.287906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1cb7a-c986-45c7-8b01-3c633b2e2e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=816495355a984e87a758ce48fee368fe, user_id=1f6bcdaae5044da7aff3722e2666fb0a, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:14.293665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1cb7a-c986-45c7-8b01-3c633b2e2e3c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:14.322937 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 880/1782] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:14 2022] PUT /identity/v3/projects/816495355a984e87a758ce48fee368fe/users/1f6bcdaae5044da7aff3722e2666fb0a/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:14.325216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aa58a-9fb9-4efb-bf61-915ab77a2e30 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:14.326086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aa58a-9fb9-4efb-bf61-915ab77a2e30 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:14.326564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aa58a-9fb9-4efb-bf61-915ab77a2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:14.494242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-176aa58a-9fb9-4efb-bf61-915ab77a2e30 None None] MFA Rules not processed for user `1f6bcdaae5044da7aff3722e2666fb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:14.502186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-176aa58a-9fb9-4efb-bf61-915ab77a2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:14.529357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4e200-b6da-4eca-97f0-9b9c6a61a45a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:14.551969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:14.832744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 881/1783] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:14.838677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0122e-f0c1-4911-a6f1-8baf45c23884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:14.840131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0122e-f0c1-4911-a6f1-8baf45c23884 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:14.840418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0122e-f0c1-4911-a6f1-8baf45c23884 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:14.841962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0122e-f0c1-4911-a6f1-8baf45c23884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:14.858099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aa58a-9fb9-4efb-bf61-915ab77a2e30 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:14.874404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0122e-f0c1-4911-a6f1-8baf45c23884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:14.879190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0122e-f0c1-4911-a6f1-8baf45c23884 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:14.955141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 903/1784] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 887 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:15.060815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aa58a-9fb9-4efb-bf61-915ab77a2e30 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:15.077782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2048360-66bd-4d2b-87a6-b538bf17e6ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:15.078611 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2048360-66bd-4d2b-87a6-b538bf17e6ec service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:15.080400 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2048360-66bd-4d2b-87a6-b538bf17e6ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:15.080400 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2048360-66bd-4d2b-87a6-b538bf17e6ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:15.128444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2048360-66bd-4d2b-87a6-b538bf17e6ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:15.132806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2048360-66bd-4d2b-87a6-b538bf17e6ec service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:15.152689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 882/1785] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:15.403953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0122e-f0c1-4911-a6f1-8baf45c23884 service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:15.405896 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-87f0122e-f0c1-4911-a6f1-8baf45c23884 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:15.505917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0122e-f0c1-4911-a6f1-8baf45c23884 service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:15.512063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:15.513016 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:15.513489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:15.516463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:15.517372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] PATH_INFO: `/v3/projects/e1755a58302a45bf9f5b1237803baa93` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:15.519170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1755a58302a45bf9f5b1237803baa93)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:15.521600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:15.558881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2048360-66bd-4d2b-87a6-b538bf17e6ec service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:15.561237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b2048360-66bd-4d2b-87a6-b538bf17e6ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:15.581291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2048360-66bd-4d2b-87a6-b538bf17e6ec service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:15.586034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97246f-3f20-4698-93c9-0123a14ad895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:15.586644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97246f-3f20-4698-93c9-0123a14ad895 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:15.586919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97246f-3f20-4698-93c9-0123a14ad895 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:15.587363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97246f-3f20-4698-93c9-0123a14ad895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:15.590617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0b97246f-3f20-4698-93c9-0123a14ad895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:15.683190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1755a58302a45bf9f5b1237803baa93', 'request_id': 'req-029ba503-5cdb-422c-86ab-8daa15935aa9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:15.702886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1755a58302a45bf9f5b1237803baa93', 'request_id': 'req-029ba503-5cdb-422c-86ab-8daa15935aa9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:15.706069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97246f-3f20-4698-93c9-0123a14ad895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:15.708927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97246f-3f20-4698-93c9-0123a14ad895 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:15.723647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1755a58302a45bf9f5b1237803baa93', 'request_id': 'req-029ba503-5cdb-422c-86ab-8daa15935aa9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:15.734928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 883/1786] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:15.827790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97246f-3f20-4698-93c9-0123a14ad895 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:15.834088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] The token cache is being invalidate because project e1755a58302a45bf9f5b1237803baa93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:15.834329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:15.835142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-029ba503-5cdb-422c-86ab-8daa15935aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:15.837124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 904/1787] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:15 2022] DELETE /identity/v3/projects/e1755a58302a45bf9f5b1237803baa93 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:15.842955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372c624-a92c-4926-9f4e-fc7489ee4cc3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:15.843582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372c624-a92c-4926-9f4e-fc7489ee4cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:15.843582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372c624-a92c-4926-9f4e-fc7489ee4cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:15.890492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e372c624-a92c-4926-9f4e-fc7489ee4cc3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:15.894197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e372c624-a92c-4926-9f4e-fc7489ee4cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:15.990921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97246f-3f20-4698-93c9-0123a14ad895 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.040470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 905/1788] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:16.049147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dcb9c-77ea-439b-94db-7157305a2383 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.049292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dcb9c-77ea-439b-94db-7157305a2383 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.061386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dcb9c-77ea-439b-94db-7157305a2383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.096957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-519dcb9c-77ea-439b-94db-7157305a2383 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:16.098869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-519dcb9c-77ea-439b-94db-7157305a2383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:16.111536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 906/1789] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:16.116066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dcb9c-77ea-439b-94db-7157305a2383 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:16.140065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d1999f69104ef3995d9a95dcbabc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ce2596d72c408493c92854842d1d79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.140917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.141819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.142207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.143096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:16.143510 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.144111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dcb9c-77ea-439b-94db-7157305a2383 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.146643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:16.151010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80084980-8259-443f-9584-23f1f81cd1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.152915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80084980-8259-443f-9584-23f1f81cd1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.153614 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80084980-8259-443f-9584-23f1f81cd1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.154330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80084980-8259-443f-9584-23f1f81cd1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.155925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80084980-8259-443f-9584-23f1f81cd1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:16.156723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80084980-8259-443f-9584-23f1f81cd1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.159480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80084980-8259-443f-9584-23f1f81cd1a4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:16.164797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 884/1790] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:03:16.170773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:16.174072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:16.189420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 907/1791] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:16.191687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80084980-8259-443f-9584-23f1f81cd1a4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:16.204472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908044-1c95-43a2-92a3-326a4b1dd344 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.226339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:16.226538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80084980-8259-443f-9584-23f1f81cd1a4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.226651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd73e02-64db-4b6e-ae6a-69d468fb9709 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d1999f69104ef3995d9a95dcbabc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ce2596d72c408493c92854842d1d79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.226651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73e02-64db-4b6e-ae6a-69d468fb9709 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.226651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73e02-64db-4b6e-ae6a-69d468fb9709 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.226922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73e02-64db-4b6e-ae6a-69d468fb9709 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.226922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd73e02-64db-4b6e-ae6a-69d468fb9709 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.226922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd73e02-64db-4b6e-ae6a-69d468fb9709 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:16.234276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449d75c-6574-4bcf-b0ba-e6867f3f3a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.235111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449d75c-6574-4bcf-b0ba-e6867f3f3a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.235550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449d75c-6574-4bcf-b0ba-e6867f3f3a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.235942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449d75c-6574-4bcf-b0ba-e6867f3f3a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.236699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449d75c-6574-4bcf-b0ba-e6867f3f3a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.238864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449d75c-6574-4bcf-b0ba-e6867f3f3a91 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:16.294909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:16.330652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 885/1792] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:16 2022] POST /identity/v3/projects => generated 355 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:16.336137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd73e02-64db-4b6e-ae6a-69d468fb9709 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:16.370924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 908/1793] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:16 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:16.395397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449d75c-6574-4bcf-b0ba-e6867f3f3a91 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:16.548390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449d75c-6574-4bcf-b0ba-e6867f3f3a91 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.548573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd73e02-64db-4b6e-ae6a-69d468fb9709 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.565691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb0ddd-aaf7-499e-b45a-1d5e3f1f7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.568590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb0ddd-aaf7-499e-b45a-1d5e3f1f7dab admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.570176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb0ddd-aaf7-499e-b45a-1d5e3f1f7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.570717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb0ddd-aaf7-499e-b45a-1d5e3f1f7dab admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.572676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb0ddd-aaf7-499e-b45a-1d5e3f1f7dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.581246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb0ddd-aaf7-499e-b45a-1d5e3f1f7dab admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:16.713626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1175-0af7-4ea6-805d-b003b0869ffc tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d1999f69104ef3995d9a95dcbabc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ce2596d72c408493c92854842d1d79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.714543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1175-0af7-4ea6-805d-b003b0869ffc tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.715593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1175-0af7-4ea6-805d-b003b0869ffc tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.715948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e1175-0af7-4ea6-805d-b003b0869ffc tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.717658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1175-0af7-4ea6-805d-b003b0869ffc tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:16.717982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1175-0af7-4ea6-805d-b003b0869ffc tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.720701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e1175-0af7-4ea6-805d-b003b0869ffc tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:16.753316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 909/1794] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:16 2022] POST /identity/v3/users => generated 303 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:16.755132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb0ddd-aaf7-499e-b45a-1d5e3f1f7dab admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:16.762719 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-36bb0ddd-aaf7-499e-b45a-1d5e3f1f7dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:16.768934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 886/1795] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:16.776249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1175-0af7-4ea6-805d-b003b0869ffc tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:16.798944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e1175-0af7-4ea6-805d-b003b0869ffc tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.800211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb0ddd-aaf7-499e-b45a-1d5e3f1f7dab admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.804546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12c422-7dd4-417e-86e7-8e27f2a6603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.805484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12c422-7dd4-417e-86e7-8e27f2a6603f admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.806512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12c422-7dd4-417e-86e7-8e27f2a6603f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.806921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.807955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12c422-7dd4-417e-86e7-8e27f2a6603f admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.809183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12c422-7dd4-417e-86e7-8e27f2a6603f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.810553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.810666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.810986 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] PATH_INFO: `/v3/users/e55a2a650ab34b269c70220626a05506` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.812771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55a2a650ab34b269c70220626a05506)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.814304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12c422-7dd4-417e-86e7-8e27f2a6603f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:16.822313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:16.830391 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 887/1796] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:16.831268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12c422-7dd4-417e-86e7-8e27f2a6603f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:16.857894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12c422-7dd4-417e-86e7-8e27f2a6603f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.864195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1a902-5a79-4ba8-9bb2-2ea08baef227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.864812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1a902-5a79-4ba8-9bb2-2ea08baef227 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.865086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1a902-5a79-4ba8-9bb2-2ea08baef227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.865358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1a902-5a79-4ba8-9bb2-2ea08baef227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.866109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1a902-5a79-4ba8-9bb2-2ea08baef227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.868169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1a902-5a79-4ba8-9bb2-2ea08baef227 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:16.892915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 888/1797] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:16.893944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1a902-5a79-4ba8-9bb2-2ea08baef227 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:16.909182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1a902-5a79-4ba8-9bb2-2ea08baef227 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:16.914957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d1999f69104ef3995d9a95dcbabc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9ce2596d72c408493c92854842d1d79', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:16.915594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:16.916728 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:16.916728 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] PATH_INFO: `/v3/projects/33a9ad4000524011b745dfa7ee871062` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:16.917557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Authorizing `identity:delete_project(project_id=33a9ad4000524011b745dfa7ee871062)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:16.919627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:17.169327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a9ad4000524011b745dfa7ee871062', 'request_id': 'req-16a43f23-4982-41bd-89c2-2862278ad375'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.184448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a9ad4000524011b745dfa7ee871062', 'request_id': 'req-16a43f23-4982-41bd-89c2-2862278ad375'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.200453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55a2a650ab34b269c70220626a05506'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.202231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55a2a650ab34b269c70220626a05506'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.203283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55a2a650ab34b269c70220626a05506'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.209825 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a9ad4000524011b745dfa7ee871062', 'request_id': 'req-16a43f23-4982-41bd-89c2-2862278ad375'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.290636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55a2a650ab34b269c70220626a05506'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.346534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55a2a650ab34b269c70220626a05506'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.362547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] The token cache is being invalidate because project 33a9ad4000524011b745dfa7ee871062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:17.363091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 910/1798] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:16 2022] DELETE /identity/v3/users/e55a2a650ab34b269c70220626a05506 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:17.363557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.365834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:17.366144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-16a43f23-4982-41bd-89c2-2862278ad375 tempest-VolumeQuotaClassesTest-941300655 tempest-VolumeQuotaClassesTest-941300655-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:17.367880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 889/1799] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:16 2022] DELETE /identity/v3/projects/33a9ad4000524011b745dfa7ee871062 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:17.371122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b006e-8625-492a-9823-c7392a207a08 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.371584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b006e-8625-492a-9823-c7392a207a08 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.372029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b006e-8625-492a-9823-c7392a207a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.380897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:17.398653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-802b006e-8625-492a-9823-c7392a207a08 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:17.399945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-802b006e-8625-492a-9823-c7392a207a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:17.470899 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 890/1800] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:17.515829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07e98-250d-4677-a8ad-8884fa99123e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.516833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07e98-250d-4677-a8ad-8884fa99123e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.520914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07e98-250d-4677-a8ad-8884fa99123e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.520914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 891/1801] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:17.522535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07e98-250d-4677-a8ad-8884fa99123e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:17.524349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-adc07e98-250d-4677-a8ad-8884fa99123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:17.643273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d618867-801e-42b6-a695-bfeb4847c0ac admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:17.682820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61540a-4f4f-446a-8abd-b4b05ec5a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:17.684721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61540a-4f4f-446a-8abd-b4b05ec5a7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.685109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61540a-4f4f-446a-8abd-b4b05ec5a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.685582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61540a-4f4f-446a-8abd-b4b05ec5a7ff admin admin] PATH_INFO: `/v3/projects/26952300e7a84f3a9f0e04c8b641ca1b/users/2e863aa2920a4a909bda9e8b0549f636/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.707313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61540a-4f4f-446a-8abd-b4b05ec5a7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=26952300e7a84f3a9f0e04c8b641ca1b, user_id=2e863aa2920a4a909bda9e8b0549f636, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:17.712163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61540a-4f4f-446a-8abd-b4b05ec5a7ff admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:17.748022 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07e98-250d-4677-a8ad-8884fa99123e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:17.752396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c4675-d17d-421e-b0d6-89c87e9987cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:17.753172 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c4675-d17d-421e-b0d6-89c87e9987cc service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.753628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c4675-d17d-421e-b0d6-89c87e9987cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.754441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c4675-d17d-421e-b0d6-89c87e9987cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.768968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:17.771563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c4675-d17d-421e-b0d6-89c87e9987cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:17.773708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c4675-d17d-421e-b0d6-89c87e9987cc service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:17.789214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 892/1802] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:17.813307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 911/1803] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:17 2022] PUT /identity/v3/projects/26952300e7a84f3a9f0e04c8b641ca1b/users/2e863aa2920a4a909bda9e8b0549f636/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:17.813307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61540a-4f4f-446a-8abd-b4b05ec5a7ff admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:17.813609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e47e9-0091-4115-8ac8-0838e897638a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.813609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e47e9-0091-4115-8ac8-0838e897638a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.813609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e47e9-0091-4115-8ac8-0838e897638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.813853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4a61540a-4f4f-446a-8abd-b4b05ec5a7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:17.884965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c62e47e9-0091-4115-8ac8-0838e897638a None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:17.888812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c62e47e9-0091-4115-8ac8-0838e897638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:17.956261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61540a-4f4f-446a-8abd-b4b05ec5a7ff admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:17.960662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:17.961185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.961494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.961841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.965186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:18.062096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:18.064280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:18.080680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 893/1804] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:03:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:18.081905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e9123-ba1e-462a-baf4-35d3b6088568 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:18.082185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e9123-ba1e-462a-baf4-35d3b6088568 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:18.082455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e9123-ba1e-462a-baf4-35d3b6088568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:18.091832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 912/1805] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:18.137503 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-db3e9123-ba1e-462a-baf4-35d3b6088568 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:18.148832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-db3e9123-ba1e-462a-baf4-35d3b6088568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:18.386880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:18.388419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:18.398255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 894/1806] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:18.420574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29510f26-3627-4cf6-8fc4-7a4e7e31af1f service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:18.425998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:18.428008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:18.428289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:18.428562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] PATH_INFO: `/v3/users/575597aa1b69435e81963d3bb3a484a5` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:18.430122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575597aa1b69435e81963d3bb3a484a5)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:18.432773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:18.448674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e9123-ba1e-462a-baf4-35d3b6088568 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:18.529652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:18.585420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e9123-ba1e-462a-baf4-35d3b6088568 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:18.585420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffa982-2f28-425c-a5ec-8cf257b7460c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:18.585420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffa982-2f28-425c-a5ec-8cf257b7460c service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:18.585420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffa982-2f28-425c-a5ec-8cf257b7460c service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:18.585971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffa982-2f28-425c-a5ec-8cf257b7460c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:18.589054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffa982-2f28-425c-a5ec-8cf257b7460c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:18.591398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffa982-2f28-425c-a5ec-8cf257b7460c service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:18.608758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 895/1807] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:19.012774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffa982-2f28-425c-a5ec-8cf257b7460c service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:19.016462 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-04ffa982-2f28-425c-a5ec-8cf257b7460c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:19.062614 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffa982-2f28-425c-a5ec-8cf257b7460c service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:19.071617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c1da0-7213-4809-9963-eadc69ae5751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:19.073867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c1da0-7213-4809-9963-eadc69ae5751 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:19.074687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c1da0-7213-4809-9963-eadc69ae5751 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:19.075404 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c1da0-7213-4809-9963-eadc69ae5751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:19.112713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c1da0-7213-4809-9963-eadc69ae5751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:19.115026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c1da0-7213-4809-9963-eadc69ae5751 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:19.134245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 896/1808] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:19.523983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575597aa1b69435e81963d3bb3a484a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:19.526965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575597aa1b69435e81963d3bb3a484a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:19.532998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575597aa1b69435e81963d3bb3a484a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:19.616644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575597aa1b69435e81963d3bb3a484a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:19.656390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575597aa1b69435e81963d3bb3a484a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:19.693110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 913/1809] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:18 2022] DELETE /identity/v3/users/575597aa1b69435e81963d3bb3a484a5 => generated 0 bytes in 1307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:19.697831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe6a03-21f3-4709-a701-d53db0743329 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:19.698581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe6a03-21f3-4709-a701-d53db0743329 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:19.702811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe6a03-21f3-4709-a701-d53db0743329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:19.738676 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2dbe6a03-21f3-4709-a701-d53db0743329 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:19.745824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2dbe6a03-21f3-4709-a701-d53db0743329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:19.783289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:19.903659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 897/1810] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:19.921259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:19.923168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:20.002345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd47bb5-d185-40e2-98d6-92e98fb12bd8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:20.006617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eaae9-5e20-481c-8b5b-c3e669cc3925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:20.013260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eaae9-5e20-481c-8b5b-c3e669cc3925 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:20.013260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eaae9-5e20-481c-8b5b-c3e669cc3925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:20.013260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eaae9-5e20-481c-8b5b-c3e669cc3925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:20.047828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe6a03-21f3-4709-a701-d53db0743329 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:20.047828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2dbe6a03-21f3-4709-a701-d53db0743329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:20.054012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eaae9-5e20-481c-8b5b-c3e669cc3925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:20.055608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eaae9-5e20-481c-8b5b-c3e669cc3925 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:20.057030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe6a03-21f3-4709-a701-d53db0743329 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:20.063570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:20.082141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:20.082141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:20.082141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] PATH_INFO: `/v3/projects/eedb90120d344780bbc030559d62722e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:20.082141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eedb90120d344780bbc030559d62722e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:20.083487 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:20.092019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 914/1811] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:20.236478 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eedb90120d344780bbc030559d62722e', 'request_id': 'req-e334c571-aa3b-4cfb-a083-f276da0cce75'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:20.265327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eedb90120d344780bbc030559d62722e', 'request_id': 'req-e334c571-aa3b-4cfb-a083-f276da0cce75'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:20.274910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eedb90120d344780bbc030559d62722e', 'request_id': 'req-e334c571-aa3b-4cfb-a083-f276da0cce75'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:20.411075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] The token cache is being invalidate because project eedb90120d344780bbc030559d62722e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:20.411811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:20.412877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:20.415526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 898/1812] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:20 2022] DELETE /identity/v3/projects/eedb90120d344780bbc030559d62722e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:20.427243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eaae9-5e20-481c-8b5b-c3e669cc3925 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:20.439253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eaae9-5e20-481c-8b5b-c3e669cc3925 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:20.511077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:20.512186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:20.512627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:20.513132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] PATH_INFO: `/v3/users/1f6bcdaae5044da7aff3722e2666fb0a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:20.516231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6bcdaae5044da7aff3722e2666fb0a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:20.520829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:21.018379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6bcdaae5044da7aff3722e2666fb0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.022593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6bcdaae5044da7aff3722e2666fb0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.022593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6bcdaae5044da7aff3722e2666fb0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.159052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6bcdaae5044da7aff3722e2666fb0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.179082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6bcdaae5044da7aff3722e2666fb0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.202544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 915/1813] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:20 2022] DELETE /identity/v3/users/1f6bcdaae5044da7aff3722e2666fb0a => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:21.417551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:21.420775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:21.441630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334c571-aa3b-4cfb-a083-f276da0cce75 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:21.525078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:21.534776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:21.535339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:21.535617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:21.535887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] PATH_INFO: `/v3/projects/c28e54653b1e4e8eb761f2c8868537d6` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:21.536987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28e54653b1e4e8eb761f2c8868537d6)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:21.539213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:21.637889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:21.688640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28e54653b1e4e8eb761f2c8868537d6', 'request_id': 'req-e7288900-4b34-4208-b808-eb503e5805ac'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.695682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28e54653b1e4e8eb761f2c8868537d6', 'request_id': 'req-e7288900-4b34-4208-b808-eb503e5805ac'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.703997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28e54653b1e4e8eb761f2c8868537d6', 'request_id': 'req-e7288900-4b34-4208-b808-eb503e5805ac'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.825086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] The token cache is being invalidate because project c28e54653b1e4e8eb761f2c8868537d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:21.825441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.826288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:21.828797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 899/1814] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:21 2022] DELETE /identity/v3/projects/c28e54653b1e4e8eb761f2c8868537d6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:21.832917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:21.836490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:21.853345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b9078-bfa1-45a9-a5d1-685f5e9348d2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:21.934579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:21.936714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:21.936714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:21.936714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] PATH_INFO: `/v3/users/63d1999f69104ef3995d9a95dcbabc42` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:21.937965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d1999f69104ef3995d9a95dcbabc42)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:21.939893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:22.056052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:22.058722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:22.073157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7288900-4b34-4208-b808-eb503e5805ac admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:22.078265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:22.085162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:22.085162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:22.085162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] PATH_INFO: `/v3/projects/816495355a984e87a758ce48fee368fe` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:22.085162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816495355a984e87a758ce48fee368fe)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:22.085162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:22.153825 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d1999f69104ef3995d9a95dcbabc42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.154491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d1999f69104ef3995d9a95dcbabc42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.155101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d1999f69104ef3995d9a95dcbabc42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.208382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816495355a984e87a758ce48fee368fe', 'request_id': 'req-5998cd3a-66bd-435a-98c0-c0c010483b33'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.214321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816495355a984e87a758ce48fee368fe', 'request_id': 'req-5998cd3a-66bd-435a-98c0-c0c010483b33'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.222618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816495355a984e87a758ce48fee368fe', 'request_id': 'req-5998cd3a-66bd-435a-98c0-c0c010483b33'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.225997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d1999f69104ef3995d9a95dcbabc42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.243357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-061b54d8-67a0-484c-b7a4-b5406a7105c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d1999f69104ef3995d9a95dcbabc42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.258370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 916/1815] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:21 2022] DELETE /identity/v3/users/63d1999f69104ef3995d9a95dcbabc42 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:22.325200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] The token cache is being invalidate because project 816495355a984e87a758ce48fee368fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:22.327135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.334716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034932fb-cfbd-4e1e-b69a-f09d68b8501e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:22.335339 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034932fb-cfbd-4e1e-b69a-f09d68b8501e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:22.335770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034932fb-cfbd-4e1e-b69a-f09d68b8501e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:22.337954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5998cd3a-66bd-435a-98c0-c0c010483b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:22.341951 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 900/1816] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:22 2022] DELETE /identity/v3/projects/816495355a984e87a758ce48fee368fe => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:22.348581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2eb0-7726-4edb-b442-e79eb1996a46 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:22.350073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2eb0-7726-4edb-b442-e79eb1996a46 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:22.350073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2eb0-7726-4edb-b442-e79eb1996a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:22.420300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-05bd2eb0-7726-4edb-b442-e79eb1996a46 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:22.424079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-05bd2eb0-7726-4edb-b442-e79eb1996a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:22.428672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-034932fb-cfbd-4e1e-b69a-f09d68b8501e None None] MFA Rules not processed for user `2e863aa2920a4a909bda9e8b0549f636`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:22.430528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-034932fb-cfbd-4e1e-b69a-f09d68b8501e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:22.534511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 917/1817] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:22.537838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 901/1818] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:22.538953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034932fb-cfbd-4e1e-b69a-f09d68b8501e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:22.540514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-034932fb-cfbd-4e1e-b69a-f09d68b8501e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:22.547368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afa7a5-3854-462f-8622-75fdab56f594 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:22.551092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afa7a5-3854-462f-8622-75fdab56f594 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:22.551092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afa7a5-3854-462f-8622-75fdab56f594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:22.563653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034932fb-cfbd-4e1e-b69a-f09d68b8501e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:22.579198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cee3a7-4307-4640-902b-21c5365fea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:22.579992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee3a7-4307-4640-902b-21c5365fea70 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:22.580573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee3a7-4307-4640-902b-21c5365fea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:22.580663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee3a7-4307-4640-902b-21c5365fea70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:22.581310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cee3a7-4307-4640-902b-21c5365fea70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:22.583327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cee3a7-4307-4640-902b-21c5365fea70 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:22.595499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c8afa7a5-3854-462f-8622-75fdab56f594 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:22.596785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c8afa7a5-3854-462f-8622-75fdab56f594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:22.612577 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 902/1819] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:22.622854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afa7a5-3854-462f-8622-75fdab56f594 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:22.636629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afa7a5-3854-462f-8622-75fdab56f594 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:22.641948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9c9f3-b217-49c8-8df9-637ca10010bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:22.642896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9c9f3-b217-49c8-8df9-637ca10010bb admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:22.643271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9c9f3-b217-49c8-8df9-637ca10010bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:22.643638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9c9f3-b217-49c8-8df9-637ca10010bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:22.644402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9c9f3-b217-49c8-8df9-637ca10010bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:22.644800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9c9f3-b217-49c8-8df9-637ca10010bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:22.646687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9c9f3-b217-49c8-8df9-637ca10010bb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:22.670794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 903/1820] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:22.672226 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9c9f3-b217-49c8-8df9-637ca10010bb admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:22.706021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9c9f3-b217-49c8-8df9-637ca10010bb admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:22.711969 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 918/1821] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:22 2022] POST /identity/v3/projects => generated 405 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:22.713061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cee3a7-4307-4640-902b-21c5365fea70 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:22.794844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cee3a7-4307-4640-902b-21c5365fea70 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:22.798516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd9b28-629c-4b66-965b-09cbd40c4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:22.799388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd9b28-629c-4b66-965b-09cbd40c4a83 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:22.805885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd9b28-629c-4b66-965b-09cbd40c4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:22.805885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd9b28-629c-4b66-965b-09cbd40c4a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:22.805885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd9b28-629c-4b66-965b-09cbd40c4a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:22.806136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f87e4-bc69-4b66-b92b-8c10bc06d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:22.806136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f87e4-bc69-4b66-b92b-8c10bc06d4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:22.806136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f87e4-bc69-4b66-b92b-8c10bc06d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:22.806136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f87e4-bc69-4b66-b92b-8c10bc06d4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:22.806408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd9b28-629c-4b66-965b-09cbd40c4a83 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:22.806476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f87e4-bc69-4b66-b92b-8c10bc06d4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:22.806476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f87e4-bc69-4b66-b92b-8c10bc06d4b5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:22.952031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 919/1822] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:22 2022] POST /identity/v3/users => generated 309 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:22.956126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f87e4-bc69-4b66-b92b-8c10bc06d4b5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:22.965857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f87e4-bc69-4b66-b92b-8c10bc06d4b5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:22.970459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b983f-481d-42b1-be53-4c1d9bb9babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:22.972204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b983f-481d-42b1-be53-4c1d9bb9babb admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:22.972204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b983f-481d-42b1-be53-4c1d9bb9babb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:22.972204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b983f-481d-42b1-be53-4c1d9bb9babb admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:22.972204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b983f-481d-42b1-be53-4c1d9bb9babb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:22.973935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b983f-481d-42b1-be53-4c1d9bb9babb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:22.984236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 920/1823] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:03:22.988214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b983f-481d-42b1-be53-4c1d9bb9babb admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.000243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b983f-481d-42b1-be53-4c1d9bb9babb admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.002777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 904/1824] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:22 2022] POST /identity/v3/projects => generated 375 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:23.004216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd9b28-629c-4b66-965b-09cbd40c4a83 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.006416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7ebd9b28-629c-4b66-965b-09cbd40c4a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.071315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a6f4d-8346-4fee-bf12-b8aa7c6970c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.071899 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a6f4d-8346-4fee-bf12-b8aa7c6970c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.072177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a6f4d-8346-4fee-bf12-b8aa7c6970c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.072476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a6f4d-8346-4fee-bf12-b8aa7c6970c1 admin admin] PATH_INFO: `/v3/projects/7bd02646e7804a06927610221f074e47/users/3b9b54c1b3474b90b32a29726aed6b1d/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.088735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a6f4d-8346-4fee-bf12-b8aa7c6970c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd02646e7804a06927610221f074e47, user_id=3b9b54c1b3474b90b32a29726aed6b1d, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.089853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd9b28-629c-4b66-965b-09cbd40c4a83 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.091437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a6f4d-8346-4fee-bf12-b8aa7c6970c1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.094564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.095171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.095443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.095737 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] PATH_INFO: `/v3/projects/b9ce2596d72c408493c92854842d1d79` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.096858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ce2596d72c408493c92854842d1d79)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.098806 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.172239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 921/1825] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:22 2022] PUT /identity/v3/projects/7bd02646e7804a06927610221f074e47/users/3b9b54c1b3474b90b32a29726aed6b1d/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:23.173050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a6f4d-8346-4fee-bf12-b8aa7c6970c1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.233342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a6f4d-8346-4fee-bf12-b8aa7c6970c1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.245438 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ce2596d72c408493c92854842d1d79', 'request_id': 'req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:23.261422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ce2596d72c408493c92854842d1d79', 'request_id': 'req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:23.265929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ce2596d72c408493c92854842d1d79', 'request_id': 'req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:23.306318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76494bc4-ac40-4460-8851-44fe0bd2f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.307028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76494bc4-ac40-4460-8851-44fe0bd2f58f admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.308536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76494bc4-ac40-4460-8851-44fe0bd2f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.308830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76494bc4-ac40-4460-8851-44fe0bd2f58f admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.309607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76494bc4-ac40-4460-8851-44fe0bd2f58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.316138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76494bc4-ac40-4460-8851-44fe0bd2f58f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.351126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] The token cache is being invalidate because project b9ce2596d72c408493c92854842d1d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:23.351344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:23.352028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:23.353617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 905/1826] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:23 2022] DELETE /identity/v3/projects/b9ce2596d72c408493c92854842d1d79 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:23.355173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.356591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.371077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf8f42-cc92-4785-8c8e-f49df6cb0818 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.380901 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790e167-7e13-4c26-81e5-46c084d75864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.381566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e167-7e13-4c26-81e5-46c084d75864 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.381848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e167-7e13-4c26-81e5-46c084d75864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.382116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e167-7e13-4c26-81e5-46c084d75864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.382766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790e167-7e13-4c26-81e5-46c084d75864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.384431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790e167-7e13-4c26-81e5-46c084d75864 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.398267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 906/1827] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:23.398267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74b7d3-e0d0-422b-a3bc-bbf4883f48e9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.398267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74b7d3-e0d0-422b-a3bc-bbf4883f48e9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.398267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74b7d3-e0d0-422b-a3bc-bbf4883f48e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.418853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cf74b7d3-e0d0-422b-a3bc-bbf4883f48e9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:23.421070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cf74b7d3-e0d0-422b-a3bc-bbf4883f48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.431564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 907/1828] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:23.434246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74b7d3-e0d0-422b-a3bc-bbf4883f48e9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.440591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 922/1829] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:23 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:23.442022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac774-762d-4222-9605-3ca4a09a3327 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.442284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac774-762d-4222-9605-3ca4a09a3327 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.442560 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ac774-762d-4222-9605-3ca4a09a3327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.445846 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74b7d3-e0d0-422b-a3bc-bbf4883f48e9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.451426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60749-62b9-4807-8c57-1e077903b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.452286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60749-62b9-4807-8c57-1e077903b0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.452567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60749-62b9-4807-8c57-1e077903b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.452844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60749-62b9-4807-8c57-1e077903b0b0 admin admin] PATH_INFO: `/v3/projects/7bd02646e7804a06927610221f074e47/users/3b9b54c1b3474b90b32a29726aed6b1d/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.454992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab60749-62b9-4807-8c57-1e077903b0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd02646e7804a06927610221f074e47, user_id=3b9b54c1b3474b90b32a29726aed6b1d, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.458054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab60749-62b9-4807-8c57-1e077903b0b0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.464499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-fc9ac774-762d-4222-9605-3ca4a09a3327 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:23.468447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fc9ac774-762d-4222-9605-3ca4a09a3327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.474343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 908/1830] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:23 2022] PUT /identity/v3/projects/7bd02646e7804a06927610221f074e47/users/3b9b54c1b3474b90b32a29726aed6b1d/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:23.475631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60749-62b9-4807-8c57-1e077903b0b0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.477403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cab60749-62b9-4807-8c57-1e077903b0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.560301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab60749-62b9-4807-8c57-1e077903b0b0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.566135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0dae-c870-4fc2-ae71-2d4b1c8a654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.568620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0dae-c870-4fc2-ae71-2d4b1c8a654b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.568963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0dae-c870-4fc2-ae71-2d4b1c8a654b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.569242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0dae-c870-4fc2-ae71-2d4b1c8a654b admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.569998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0dae-c870-4fc2-ae71-2d4b1c8a654b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.571980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0dae-c870-4fc2-ae71-2d4b1c8a654b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.593097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 909/1831] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:23.594390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0dae-c870-4fc2-ae71-2d4b1c8a654b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.600898 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 923/1832] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:23.605007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0dae-c870-4fc2-ae71-2d4b1c8a654b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.606039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ac774-762d-4222-9605-3ca4a09a3327 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.610359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf005f64-aa0a-4c84-8fbf-16400983a379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.611015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf005f64-aa0a-4c84-8fbf-16400983a379 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.611303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf005f64-aa0a-4c84-8fbf-16400983a379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.611567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf005f64-aa0a-4c84-8fbf-16400983a379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.612211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf005f64-aa0a-4c84-8fbf-16400983a379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.613910 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf005f64-aa0a-4c84-8fbf-16400983a379 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.615242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ac774-762d-4222-9605-3ca4a09a3327 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.620315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5900c-2111-4a02-be04-4568d6b2aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.621125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5900c-2111-4a02-be04-4568d6b2aad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.621503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5900c-2111-4a02-be04-4568d6b2aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.621834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5900c-2111-4a02-be04-4568d6b2aad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.622535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5900c-2111-4a02-be04-4568d6b2aad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:23.622835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5900c-2111-4a02-be04-4568d6b2aad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.624275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 910/1833] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:03:23.624443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5900c-2111-4a02-be04-4568d6b2aad0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.634970 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf005f64-aa0a-4c84-8fbf-16400983a379 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.639816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 924/1834] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:03:23.640705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5900c-2111-4a02-be04-4568d6b2aad0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.645229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf005f64-aa0a-4c84-8fbf-16400983a379 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.649951 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91c5e2-ecb4-418a-9886-3199f54766dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.650094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5900c-2111-4a02-be04-4568d6b2aad0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.650603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91c5e2-ecb4-418a-9886-3199f54766dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.651412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91c5e2-ecb4-418a-9886-3199f54766dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.651686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91c5e2-ecb4-418a-9886-3199f54766dd admin admin] PATH_INFO: `/v3/projects/0a518a6714e945d2868f7d0f6fec017a/users/35f775ab51684ecd8362ad8f7a0ddf2c/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.655393 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd126-dfee-4412-8e0c-793ebcc4b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.655971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd126-dfee-4412-8e0c-793ebcc4b5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.656243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd126-dfee-4412-8e0c-793ebcc4b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.656509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd126-dfee-4412-8e0c-793ebcc4b5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.657148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dd126-dfee-4412-8e0c-793ebcc4b5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.659105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dd126-dfee-4412-8e0c-793ebcc4b5c0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.669389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91c5e2-ecb4-418a-9886-3199f54766dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a518a6714e945d2868f7d0f6fec017a, user_id=35f775ab51684ecd8362ad8f7a0ddf2c, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.672842 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91c5e2-ecb4-418a-9886-3199f54766dd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.744913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 925/1835] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:23 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:23.746382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd126-dfee-4412-8e0c-793ebcc4b5c0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.787111 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 911/1836] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:23 2022] PUT /identity/v3/projects/0a518a6714e945d2868f7d0f6fec017a/users/35f775ab51684ecd8362ad8f7a0ddf2c/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:23.798397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f899d6-8491-4489-bd5e-9fcbd05e6bd9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.798679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f899d6-8491-4489-bd5e-9fcbd05e6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.798955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f899d6-8491-4489-bd5e-9fcbd05e6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.828324 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd126-dfee-4412-8e0c-793ebcc4b5c0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.831710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f0f899d6-8491-4489-bd5e-9fcbd05e6bd9 None None] MFA Rules not processed for user `35f775ab51684ecd8362ad8f7a0ddf2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:23.833219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f0f899d6-8491-4489-bd5e-9fcbd05e6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.907950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b45be-e5b2-4d72-b35d-d631ec071651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.908626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b45be-e5b2-4d72-b35d-d631ec071651 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.908847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b45be-e5b2-4d72-b35d-d631ec071651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.909116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b45be-e5b2-4d72-b35d-d631ec071651 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.910130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b45be-e5b2-4d72-b35d-d631ec071651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.918109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b45be-e5b2-4d72-b35d-d631ec071651 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.925386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 912/1837] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:23.937775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f899d6-8491-4489-bd5e-9fcbd05e6bd9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.939387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f0f899d6-8491-4489-bd5e-9fcbd05e6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.996979 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f899d6-8491-4489-bd5e-9fcbd05e6bd9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:24.000601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99676-ff0d-4f67-bf69-af537550e281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:24.001218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99676-ff0d-4f67-bf69-af537550e281 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.001555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99676-ff0d-4f67-bf69-af537550e281 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.001826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99676-ff0d-4f67-bf69-af537550e281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.009090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 926/1838] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:23 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:24.010860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99676-ff0d-4f67-bf69-af537550e281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:24.012940 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99676-ff0d-4f67-bf69-af537550e281 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:24.013876 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b45be-e5b2-4d72-b35d-d631ec071651 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:24.022485 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:24.024478 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 913/1839] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:24.027777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b45be-e5b2-4d72-b35d-d631ec071651 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:24.032827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdccb1-35c8-4600-9b75-060a631c8cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:24.033450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdccb1-35c8-4600-9b75-060a631c8cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.033817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdccb1-35c8-4600-9b75-060a631c8cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.034089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdccb1-35c8-4600-9b75-060a631c8cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.034742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdccb1-35c8-4600-9b75-060a631c8cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:24.036338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdccb1-35c8-4600-9b75-060a631c8cf1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:24.052931 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 927/1840] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:24.057457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99676-ff0d-4f67-bf69-af537550e281 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:24.069297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99676-ff0d-4f67-bf69-af537550e281 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:24.083994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c43e0-f87a-4cb1-b8da-433900d34ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:24.084613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c43e0-f87a-4cb1-b8da-433900d34ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.084888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c43e0-f87a-4cb1-b8da-433900d34ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.085155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c43e0-f87a-4cb1-b8da-433900d34ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.085850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c43e0-f87a-4cb1-b8da-433900d34ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:24.087455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c43e0-f87a-4cb1-b8da-433900d34ad1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:24.100345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:24.109937 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 914/1841] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:24.124114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdccb1-35c8-4600-9b75-060a631c8cf1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:24.140917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdccb1-35c8-4600-9b75-060a631c8cf1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:24.158292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1f95d-fa02-414c-9c87-0af440ca9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:24.158993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f95d-fa02-414c-9c87-0af440ca9554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.159276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f95d-fa02-414c-9c87-0af440ca9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.159556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f95d-fa02-414c-9c87-0af440ca9554 admin admin] PATH_INFO: `/v3/projects/a74c495606e24bbab77800a62ed63fba/users/fc453eb824a64d32a1e6760f0f1e4a5b/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.201632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1f95d-fa02-414c-9c87-0af440ca9554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74c495606e24bbab77800a62ed63fba, user_id=fc453eb824a64d32a1e6760f0f1e4a5b, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:24.206703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1f95d-fa02-414c-9c87-0af440ca9554 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:24.294467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 928/1842] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:24 2022] PUT /identity/v3/projects/a74c495606e24bbab77800a62ed63fba/users/fc453eb824a64d32a1e6760f0f1e4a5b/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:24.296495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823ad00-dff0-4fa8-9b5b-43cca11a3879 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.296796 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823ad00-dff0-4fa8-9b5b-43cca11a3879 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.297065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823ad00-dff0-4fa8-9b5b-43cca11a3879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.340787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2823ad00-dff0-4fa8-9b5b-43cca11a3879 None None] MFA Rules not processed for user `fc453eb824a64d32a1e6760f0f1e4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:24.342601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2823ad00-dff0-4fa8-9b5b-43cca11a3879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:24.461319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 915/1843] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:24.468238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1f95d-fa02-414c-9c87-0af440ca9554 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:24.574372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1f95d-fa02-414c-9c87-0af440ca9554 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:24.579443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69b4e5-27a0-41fe-a295-854a1df6896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:24.580136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69b4e5-27a0-41fe-a295-854a1df6896a admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.580372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69b4e5-27a0-41fe-a295-854a1df6896a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.580641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69b4e5-27a0-41fe-a295-854a1df6896a admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.581278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69b4e5-27a0-41fe-a295-854a1df6896a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:24.584168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69b4e5-27a0-41fe-a295-854a1df6896a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:24.682987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 929/1844] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:24 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:24.687028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823ad00-dff0-4fa8-9b5b-43cca11a3879 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:24.703777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823ad00-dff0-4fa8-9b5b-43cca11a3879 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:24.780717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ce8ed-fb39-4542-9f89-ebc4ff08c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:24.781508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ce8ed-fb39-4542-9f89-ebc4ff08c97f admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.781631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ce8ed-fb39-4542-9f89-ebc4ff08c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.781904 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ce8ed-fb39-4542-9f89-ebc4ff08c97f admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.782823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ce8ed-fb39-4542-9f89-ebc4ff08c97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:24.784860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ce8ed-fb39-4542-9f89-ebc4ff08c97f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:24.805143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:24.848543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 916/1845] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:24 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:24.850888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69b4e5-27a0-41fe-a295-854a1df6896a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:24.870995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69b4e5-27a0-41fe-a295-854a1df6896a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:24.877595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b2936-34c0-41c9-a9e8-2c5738d528f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:24.878226 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b2936-34c0-41c9-a9e8-2c5738d528f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.878511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b2936-34c0-41c9-a9e8-2c5738d528f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.879032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b2936-34c0-41c9-a9e8-2c5738d528f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.880166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b2936-34c0-41c9-a9e8-2c5738d528f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:24.882263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b2936-34c0-41c9-a9e8-2c5738d528f4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:24.903557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 930/1846] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:24.905053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ce8ed-fb39-4542-9f89-ebc4ff08c97f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:24.921851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ce8ed-fb39-4542-9f89-ebc4ff08c97f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:24.928587 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cd80d-0829-4449-9ec9-7affd099eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:24.929306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cd80d-0829-4449-9ec9-7affd099eb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:24.929629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cd80d-0829-4449-9ec9-7affd099eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:24.929907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cd80d-0829-4449-9ec9-7affd099eb83 admin admin] PATH_INFO: `/v3/projects/311e1c70c1a94586971c3a292c0debb2/users/f8167834c8984a56b41fd1c970085597/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:24.956088 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cd80d-0829-4449-9ec9-7affd099eb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311e1c70c1a94586971c3a292c0debb2, user_id=f8167834c8984a56b41fd1c970085597, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:24.968050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cd80d-0829-4449-9ec9-7affd099eb83 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:25.056506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 917/1847] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:24 2022] PUT /identity/v3/projects/311e1c70c1a94586971c3a292c0debb2/users/f8167834c8984a56b41fd1c970085597/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:25.063265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b2936-34c0-41c9-a9e8-2c5738d528f4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:25.083460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b2936-34c0-41c9-a9e8-2c5738d528f4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:25.163145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a4f9-b14c-4c82-94d1-801622bd17ea None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:25.163428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a4f9-b14c-4c82-94d1-801622bd17ea None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:25.163784 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91a4f9-b14c-4c82-94d1-801622bd17ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:25.205064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b741b63-eb26-4867-9f3e-5b75007b9089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:25.205787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b741b63-eb26-4867-9f3e-5b75007b9089 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:25.206006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b741b63-eb26-4867-9f3e-5b75007b9089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:25.206274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b741b63-eb26-4867-9f3e-5b75007b9089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:25.206930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b741b63-eb26-4867-9f3e-5b75007b9089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:25.208665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b741b63-eb26-4867-9f3e-5b75007b9089 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:25.234989 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cb91a4f9-b14c-4c82-94d1-801622bd17ea None None] MFA Rules not processed for user `3b9b54c1b3474b90b32a29726aed6b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:25.236230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cb91a4f9-b14c-4c82-94d1-801622bd17ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:25.241497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 931/1848] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:25.242426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b741b63-eb26-4867-9f3e-5b75007b9089 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:25.285975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b741b63-eb26-4867-9f3e-5b75007b9089 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:25.290996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dafed-1d50-4195-80aa-3eb416d1e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:25.292417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dafed-1d50-4195-80aa-3eb416d1e34a admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:25.293003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dafed-1d50-4195-80aa-3eb416d1e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:25.293367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dafed-1d50-4195-80aa-3eb416d1e34a admin admin] PATH_INFO: `/v3/projects/311e1c70c1a94586971c3a292c0debb2/users/f8167834c8984a56b41fd1c970085597/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:25.297290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dafed-1d50-4195-80aa-3eb416d1e34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=311e1c70c1a94586971c3a292c0debb2, user_id=f8167834c8984a56b41fd1c970085597, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:25.303746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dafed-1d50-4195-80aa-3eb416d1e34a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:25.346055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 932/1849] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:25 2022] PUT /identity/v3/projects/311e1c70c1a94586971c3a292c0debb2/users/f8167834c8984a56b41fd1c970085597/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:25.349731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f143-cf92-4bad-b449-202c0c4b3916 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:25.350204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f143-cf92-4bad-b449-202c0c4b3916 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:25.350652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43f143-cf92-4bad-b449-202c0c4b3916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:25.403785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 918/1850] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:25.446377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1e43f143-cf92-4bad-b449-202c0c4b3916 None None] MFA Rules not processed for user `f8167834c8984a56b41fd1c970085597`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:25.447970 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1e43f143-cf92-4bad-b449-202c0c4b3916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:25.582530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 933/1851] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:25.595169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a4f9-b14c-4c82-94d1-801622bd17ea None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:25.668594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91a4f9-b14c-4c82-94d1-801622bd17ea None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:25.774603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccf059-fb23-43c7-a9f0-7e6f6e7d0dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:25.775563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccf059-fb23-43c7-a9f0-7e6f6e7d0dee service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:25.776740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccf059-fb23-43c7-a9f0-7e6f6e7d0dee service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:25.777018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccf059-fb23-43c7-a9f0-7e6f6e7d0dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:25.787930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccf059-fb23-43c7-a9f0-7e6f6e7d0dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:25.789539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccf059-fb23-43c7-a9f0-7e6f6e7d0dee service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:25.805004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 919/1852] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:26.567873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35fd1-d481-4185-b4ca-8e36e6cbdf02 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:26.568716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35fd1-d481-4185-b4ca-8e36e6cbdf02 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:26.569130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35fd1-d481-4185-b4ca-8e36e6cbdf02 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:26.571665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 934/1853] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:03:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:26.596197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb7461-09da-4c74-b532-d6f54d3db476 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:26.596662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb7461-09da-4c74-b532-d6f54d3db476 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:26.596824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb7461-09da-4c74-b532-d6f54d3db476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:26.636623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1ffb7461-09da-4c74-b532-d6f54d3db476 None None] MFA Rules not processed for user `00093949026746f29def86e4a0b48bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:26.638247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1ffb7461-09da-4c74-b532-d6f54d3db476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:26.661297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518c7d-1b04-4cdd-bea1-b3cc6aa6e780 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:26.661724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518c7d-1b04-4cdd-bea1-b3cc6aa6e780 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:26.662058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518c7d-1b04-4cdd-bea1-b3cc6aa6e780 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:26.663511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 935/1854] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:03:26.706169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c960-653e-4725-8937-8ad8aed41977 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:26.706656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c960-653e-4725-8937-8ad8aed41977 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:26.707143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c960-653e-4725-8937-8ad8aed41977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:26.750299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d635c960-653e-4725-8937-8ad8aed41977 None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:26.752033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d635c960-653e-4725-8937-8ad8aed41977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:26.859632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 920/1855] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:26.936255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb7461-09da-4c74-b532-d6f54d3db476 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:26.939100 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1ffb7461-09da-4c74-b532-d6f54d3db476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:26.975826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb7461-09da-4c74-b532-d6f54d3db476 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:26.985783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 936/1856] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:27.006693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540fc48-7d94-4482-baca-e68a6a2bdb68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:27.008658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540fc48-7d94-4482-baca-e68a6a2bdb68 service placement] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:27.008951 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540fc48-7d94-4482-baca-e68a6a2bdb68 service placement] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:27.009227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540fc48-7d94-4482-baca-e68a6a2bdb68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:27.042572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540fc48-7d94-4482-baca-e68a6a2bdb68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:27.044748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540fc48-7d94-4482-baca-e68a6a2bdb68 service placement] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:27.069240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 921/1857] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:27.091049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635c960-653e-4725-8937-8ad8aed41977 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:27.092945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d635c960-653e-4725-8937-8ad8aed41977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:27.123441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635c960-653e-4725-8937-8ad8aed41977 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:27.136524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:27.146446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fc5bf-befd-4efb-bc64-875db13edd09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:27.147081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fc5bf-befd-4efb-bc64-875db13edd09 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:27.147644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fc5bf-befd-4efb-bc64-875db13edd09 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:27.147644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fc5bf-befd-4efb-bc64-875db13edd09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:27.176619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fc5bf-befd-4efb-bc64-875db13edd09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:27.176619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fc5bf-befd-4efb-bc64-875db13edd09 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:27.185951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 937/1858] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:27.761106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540fc48-7d94-4482-baca-e68a6a2bdb68 service placement] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:27.910476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540fc48-7d94-4482-baca-e68a6a2bdb68 service placement] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:27.917115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:27.918409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:27.918992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:27.919407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] PATH_INFO: `/v3/users/fc453eb824a64d32a1e6760f0f1e4a5b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:27.921013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc453eb824a64d32a1e6760f0f1e4a5b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:27.923790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:28.071229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9a1f6-9066-421c-8e9f-c297b21c53e8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:28.071804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9a1f6-9066-421c-8e9f-c297b21c53e8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:28.071987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9a1f6-9066-421c-8e9f-c297b21c53e8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:28.074351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 938/1859] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:28.113663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd8ff-3914-42b9-9ad7-bf14398fdded None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:28.122238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd8ff-3914-42b9-9ad7-bf14398fdded None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:28.122238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cd8ff-3914-42b9-9ad7-bf14398fdded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:28.148500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-504cd8ff-3914-42b9-9ad7-bf14398fdded None None] MFA Rules not processed for user `00093949026746f29def86e4a0b48bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:28.149982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-504cd8ff-3914-42b9-9ad7-bf14398fdded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:28.164482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 939/1860] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:03:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:28.176584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:28.185040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc453eb824a64d32a1e6760f0f1e4a5b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.192728 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc453eb824a64d32a1e6760f0f1e4a5b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.193528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc453eb824a64d32a1e6760f0f1e4a5b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.194139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc453eb824a64d32a1e6760f0f1e4a5b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.231326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd8ff-3914-42b9-9ad7-bf14398fdded None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:28.244657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cd8ff-3914-42b9-9ad7-bf14398fdded None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:28.271411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:28.272098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:28.272379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:28.272647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:28.275776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:28.287150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5baba476-f785-4ca5-802c-055d480d60c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc453eb824a64d32a1e6760f0f1e4a5b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.308645 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:28.309704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 922/1861] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:27 2022] DELETE /identity/v3/users/fc453eb824a64d32a1e6760f0f1e4a5b => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:28.310986 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:28.314083 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15adbb-3a4a-4c23-a6f6-7b1dcc03f3dc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:28.318570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15adbb-3a4a-4c23-a6f6-7b1dcc03f3dc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:28.318570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15adbb-3a4a-4c23-a6f6-7b1dcc03f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:28.327841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 940/1862] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:28.348793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4e15adbb-3a4a-4c23-a6f6-7b1dcc03f3dc None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:28.350748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4e15adbb-3a4a-4c23-a6f6-7b1dcc03f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:28.446259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 923/1863] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:28.450156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:28.453124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:28.461943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15adbb-3a4a-4c23-a6f6-7b1dcc03f3dc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:28.464761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4e15adbb-3a4a-4c23-a6f6-7b1dcc03f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:28.485028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267511b5-4e72-40e4-bf44-13ec90a6c129 service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:28.497540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:28.499427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:28.499427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:28.499716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] PATH_INFO: `/v3/users/2e863aa2920a4a909bda9e8b0549f636` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:28.501158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e863aa2920a4a909bda9e8b0549f636)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:28.503281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:28.566472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15adbb-3a4a-4c23-a6f6-7b1dcc03f3dc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:28.569912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96ce17-270b-43bf-9431-395c09385599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:28.570754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96ce17-270b-43bf-9431-395c09385599 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:28.570930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96ce17-270b-43bf-9431-395c09385599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:28.571212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96ce17-270b-43bf-9431-395c09385599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:28.581907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96ce17-270b-43bf-9431-395c09385599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:28.583693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96ce17-270b-43bf-9431-395c09385599 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:28.594807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 924/1864] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:28.800454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e863aa2920a4a909bda9e8b0549f636'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.801112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e863aa2920a4a909bda9e8b0549f636'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.801769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e863aa2920a4a909bda9e8b0549f636'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.865478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e863aa2920a4a909bda9e8b0549f636'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.882077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e863aa2920a4a909bda9e8b0549f636'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:28.899633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 941/1865] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:28 2022] DELETE /identity/v3/users/2e863aa2920a4a909bda9e8b0549f636 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:29.094130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96ce17-270b-43bf-9431-395c09385599 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:29.096163 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ae96ce17-270b-43bf-9431-395c09385599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:29.125265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96ce17-270b-43bf-9431-395c09385599 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:29.183789 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:29.184689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:29.184959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:29.185934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] PATH_INFO: `/v3/projects/a74c495606e24bbab77800a62ed63fba` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:29.186685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74c495606e24bbab77800a62ed63fba)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:29.188573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:29.193114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:29.196172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:29.215735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62a85c-3c94-445b-a18f-df0cf87169ac admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:29.223240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:29.224552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:29.224834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:29.225105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] PATH_INFO: `/v3/projects/26952300e7a84f3a9f0e04c8b641ca1b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:29.226459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26952300e7a84f3a9f0e04c8b641ca1b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:29.228421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:29.334178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74c495606e24bbab77800a62ed63fba', 'request_id': 'req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.348884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74c495606e24bbab77800a62ed63fba', 'request_id': 'req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.354779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26952300e7a84f3a9f0e04c8b641ca1b', 'request_id': 'req-083d3a97-aa8e-4811-aefe-f420214972a7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.356651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74c495606e24bbab77800a62ed63fba', 'request_id': 'req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.362976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26952300e7a84f3a9f0e04c8b641ca1b', 'request_id': 'req-083d3a97-aa8e-4811-aefe-f420214972a7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.370612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26952300e7a84f3a9f0e04c8b641ca1b', 'request_id': 'req-083d3a97-aa8e-4811-aefe-f420214972a7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.433567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] The token cache is being invalidate because project a74c495606e24bbab77800a62ed63fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:29.433567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.433567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.436710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 925/1866] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:29 2022] DELETE /identity/v3/projects/a74c495606e24bbab77800a62ed63fba => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:29.436710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:29.448198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:29.499167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] The token cache is being invalidate because project 26952300e7a84f3a9f0e04c8b641ca1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:29.499555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.500253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.501998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 942/1867] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:29 2022] DELETE /identity/v3/projects/26952300e7a84f3a9f0e04c8b641ca1b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:29.513518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:29.520808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:29.539348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc91f1-61c1-4769-9a4f-0ebaf79560b7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:29.603583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d3a97-aa8e-4811-aefe-f420214972a7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:29.606192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:29.607162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:29.607504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:29.607777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] PATH_INFO: `/v3/users/35f775ab51684ecd8362ad8f7a0ddf2c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:29.608965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f775ab51684ecd8362ad8f7a0ddf2c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:29.609507 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:29.610138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:29.610465 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:29.610734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] PATH_INFO: `/v3/users/f8167834c8984a56b41fd1c970085597` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:29.610912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:29.611951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8167834c8984a56b41fd1c970085597)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:29.614095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:29.805851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8167834c8984a56b41fd1c970085597'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.806547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8167834c8984a56b41fd1c970085597'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.813290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8167834c8984a56b41fd1c970085597'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.876449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f775ab51684ecd8362ad8f7a0ddf2c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.887681 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f775ab51684ecd8362ad8f7a0ddf2c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.888429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f775ab51684ecd8362ad8f7a0ddf2c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.888791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8167834c8984a56b41fd1c970085597'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.889035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f775ab51684ecd8362ad8f7a0ddf2c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.909745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8167834c8984a56b41fd1c970085597'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.923131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 943/1868] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:29 2022] DELETE /identity/v3/users/f8167834c8984a56b41fd1c970085597 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:29.923946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:29.925680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:29.975095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ec0e2e1c-c7e2-4164-b210-b22d449cdd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f775ab51684ecd8362ad8f7a0ddf2c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:29.999886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 926/1869] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:29 2022] DELETE /identity/v3/users/35f775ab51684ecd8362ad8f7a0ddf2c => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:30.005552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925e689-e92d-49f2-98ac-d24c9c4f0947 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:30.006386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925e689-e92d-49f2-98ac-d24c9c4f0947 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:30.006829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925e689-e92d-49f2-98ac-d24c9c4f0947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:30.008570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ada2ca-9f82-4f40-91f9-77823b733930 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:30.036254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-8925e689-e92d-49f2-98ac-d24c9c4f0947 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:30.037656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8925e689-e92d-49f2-98ac-d24c9c4f0947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:30.076803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:30.077438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:30.077740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:30.078004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] PATH_INFO: `/v3/users/3b9b54c1b3474b90b32a29726aed6b1d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:30.079160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9b54c1b3474b90b32a29726aed6b1d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:30.081209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:30.111585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 927/1870] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:30.132034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925e689-e92d-49f2-98ac-d24c9c4f0947 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:30.133951 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8925e689-e92d-49f2-98ac-d24c9c4f0947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:30.212185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:30.225303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925e689-e92d-49f2-98ac-d24c9c4f0947 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:30.227847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9b54c1b3474b90b32a29726aed6b1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.228527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9b54c1b3474b90b32a29726aed6b1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.229848 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9b54c1b3474b90b32a29726aed6b1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.231525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:30.232537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:30.233281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:30.233891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:30.238133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:30.257127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:30.259954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:30.277613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 928/1871] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:30.323839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9b54c1b3474b90b32a29726aed6b1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.349913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9b54c1b3474b90b32a29726aed6b1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.373144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 944/1872] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:29 2022] DELETE /identity/v3/users/3b9b54c1b3474b90b32a29726aed6b1d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:30.470280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:30.472598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:30.506150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec63dd3-7bd7-4e72-b222-a91fcae7a579 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:30.617191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:30.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:30.618417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:30.618608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] PATH_INFO: `/v3/projects/311e1c70c1a94586971c3a292c0debb2` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:30.620038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=311e1c70c1a94586971c3a292c0debb2)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:30.622037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:30.754516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:30.756109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:30.773792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12934246-ce67-4801-9bae-fd71aff12b65 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:30.802709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:30.803608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:30.805417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:30.806942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] PATH_INFO: `/v3/projects/7bd02646e7804a06927610221f074e47` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:30.809610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd02646e7804a06927610221f074e47)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:30.812945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:30.824433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311e1c70c1a94586971c3a292c0debb2', 'request_id': 'req-8c894937-980c-42b5-8063-7d70162844ef'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.831319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311e1c70c1a94586971c3a292c0debb2', 'request_id': 'req-8c894937-980c-42b5-8063-7d70162844ef'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.849651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311e1c70c1a94586971c3a292c0debb2', 'request_id': 'req-8c894937-980c-42b5-8063-7d70162844ef'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.954448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] The token cache is being invalidate because project 311e1c70c1a94586971c3a292c0debb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:30.954749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.960114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8c894937-980c-42b5-8063-7d70162844ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:30.966624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 929/1873] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:30 2022] DELETE /identity/v3/projects/311e1c70c1a94586971c3a292c0debb2 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:30.973797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7cd4-9f9d-4012-bf61-5fecbb7ae9f7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:30.975428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7cd4-9f9d-4012-bf61-5fecbb7ae9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:30.975428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7cd4-9f9d-4012-bf61-5fecbb7ae9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:30.997186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-51dd7cd4-9f9d-4012-bf61-5fecbb7ae9f7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:30.998549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-51dd7cd4-9f9d-4012-bf61-5fecbb7ae9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:31.002290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd02646e7804a06927610221f074e47', 'request_id': 'req-6d242162-3db8-486f-b39c-8d4367b49c2a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.008847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd02646e7804a06927610221f074e47', 'request_id': 'req-6d242162-3db8-486f-b39c-8d4367b49c2a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.015710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd02646e7804a06927610221f074e47', 'request_id': 'req-6d242162-3db8-486f-b39c-8d4367b49c2a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.033660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:31.090778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] The token cache is being invalidate because project 7bd02646e7804a06927610221f074e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:31.091175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.091798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d242162-3db8-486f-b39c-8d4367b49c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.093763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 945/1874] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:30 2022] DELETE /identity/v3/projects/7bd02646e7804a06927610221f074e47 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:31.099050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f909-8366-47a6-b37f-8dabb3dd15bb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.099050 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f909-8366-47a6-b37f-8dabb3dd15bb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.101260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f909-8366-47a6-b37f-8dabb3dd15bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.110990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 930/1875] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:31.118602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34037-83cb-49a1-9340-52d62a1a82f7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.119075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34037-83cb-49a1-9340-52d62a1a82f7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.120079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34037-83cb-49a1-9340-52d62a1a82f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.142301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-8fc34037-83cb-49a1-9340-52d62a1a82f7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:31.143757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8fc34037-83cb-49a1-9340-52d62a1a82f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:31.152648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 931/1876] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:31.153606 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8f58f909-8366-47a6-b37f-8dabb3dd15bb None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:31.156379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8f58f909-8366-47a6-b37f-8dabb3dd15bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:31.156852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34037-83cb-49a1-9340-52d62a1a82f7 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.158212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8fc34037-83cb-49a1-9340-52d62a1a82f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:31.176784 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34037-83cb-49a1-9340-52d62a1a82f7 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.181711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.182373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.183263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.183263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] PATH_INFO: `/v3/projects/0a518a6714e945d2868f7d0f6fec017a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.184376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a518a6714e945d2868f7d0f6fec017a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.186326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.187311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 946/1877] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:31.188344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58f909-8366-47a6-b37f-8dabb3dd15bb None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.203811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58f909-8366-47a6-b37f-8dabb3dd15bb None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.217372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270269d-6ad0-4c7a-9071-005868adeb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.223864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270269d-6ad0-4c7a-9071-005868adeb71 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.223864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270269d-6ad0-4c7a-9071-005868adeb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.223864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270269d-6ad0-4c7a-9071-005868adeb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.223864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270269d-6ad0-4c7a-9071-005868adeb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:31.223864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270269d-6ad0-4c7a-9071-005868adeb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.226103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270269d-6ad0-4c7a-9071-005868adeb71 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.243771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 947/1878] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:31.246409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01b22-6c8e-4847-a6f9-762f804cd200 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.246922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01b22-6c8e-4847-a6f9-762f804cd200 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.247382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01b22-6c8e-4847-a6f9-762f804cd200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.276860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-64f01b22-6c8e-4847-a6f9-762f804cd200 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:31.278340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-64f01b22-6c8e-4847-a6f9-762f804cd200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:31.289659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 948/1879] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:31.290701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f01b22-6c8e-4847-a6f9-762f804cd200 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.305189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f01b22-6c8e-4847-a6f9-762f804cd200 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.317098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706c0e9-f38e-4cc9-94ab-b3ab235b6807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.320287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706c0e9-f38e-4cc9-94ab-b3ab235b6807 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.320587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706c0e9-f38e-4cc9-94ab-b3ab235b6807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.320859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706c0e9-f38e-4cc9-94ab-b3ab235b6807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.321545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706c0e9-f38e-4cc9-94ab-b3ab235b6807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.323989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706c0e9-f38e-4cc9-94ab-b3ab235b6807 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.348394 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a518a6714e945d2868f7d0f6fec017a', 'request_id': 'req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.356436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a518a6714e945d2868f7d0f6fec017a', 'request_id': 'req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.363291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a518a6714e945d2868f7d0f6fec017a', 'request_id': 'req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.423538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 949/1880] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:31.424679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706c0e9-f38e-4cc9-94ab-b3ab235b6807 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.449242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] The token cache is being invalidate because project 0a518a6714e945d2868f7d0f6fec017a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:31.449717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.450462 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:31.452537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 932/1881] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:31 2022] DELETE /identity/v3/projects/0a518a6714e945d2868f7d0f6fec017a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:31.453199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.454671 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:31.497417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706c0e9-f38e-4cc9-94ab-b3ab235b6807 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.502123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f108fe-76b1-44e4-a87a-ca0cbd607342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.502727 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f108fe-76b1-44e4-a87a-ca0cbd607342 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.503788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f108fe-76b1-44e4-a87a-ca0cbd607342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.503788 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f108fe-76b1-44e4-a87a-ca0cbd607342 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.504137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f108fe-76b1-44e4-a87a-ca0cbd607342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:31.504434 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f108fe-76b1-44e4-a87a-ca0cbd607342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.506068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f108fe-76b1-44e4-a87a-ca0cbd607342 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.517696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 950/1882] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:31.519021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0b90-8bb4-48fe-ba48-94cc26faacf3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.519303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0b90-8bb4-48fe-ba48-94cc26faacf3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.519573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc0b90-8bb4-48fe-ba48-94cc26faacf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.521841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635750f-ad7a-45dc-a42c-bd2ab11aeb1d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.526805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1b4a0-908c-4c86-9008-1c066f652492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.527417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1b4a0-908c-4c86-9008-1c066f652492 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.527692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1b4a0-908c-4c86-9008-1c066f652492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.527963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1b4a0-908c-4c86-9008-1c066f652492 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.528632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1b4a0-908c-4c86-9008-1c066f652492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.530576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1b4a0-908c-4c86-9008-1c066f652492 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.538517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ffdc0b90-8bb4-48fe-ba48-94cc26faacf3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:31.539702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ffdc0b90-8bb4-48fe-ba48-94cc26faacf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:31.548020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 951/1883] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:31.548799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc0b90-8bb4-48fe-ba48-94cc26faacf3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.550052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ffdc0b90-8bb4-48fe-ba48-94cc26faacf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:31.563552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc0b90-8bb4-48fe-ba48-94cc26faacf3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.566317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aff8b4-bad0-4d25-960a-fe870d7b714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.566944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aff8b4-bad0-4d25-960a-fe870d7b714e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.567183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aff8b4-bad0-4d25-960a-fe870d7b714e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.567450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aff8b4-bad0-4d25-960a-fe870d7b714e admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.568069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aff8b4-bad0-4d25-960a-fe870d7b714e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.570055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aff8b4-bad0-4d25-960a-fe870d7b714e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.624235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 933/1884] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:31.624235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b152672-bf25-4635-979a-a194212280b0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.624235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b152672-bf25-4635-979a-a194212280b0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.624235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b152672-bf25-4635-979a-a194212280b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.642804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0b152672-bf25-4635-979a-a194212280b0 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:31.643992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0b152672-bf25-4635-979a-a194212280b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:31.652604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 934/1885] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:31.653629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b152672-bf25-4635-979a-a194212280b0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.662635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b152672-bf25-4635-979a-a194212280b0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.668034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51342d47-605c-4646-90e0-bda29f832c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.668613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51342d47-605c-4646-90e0-bda29f832c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.669750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51342d47-605c-4646-90e0-bda29f832c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.669750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51342d47-605c-4646-90e0-bda29f832c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.669909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51342d47-605c-4646-90e0-bda29f832c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.671432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51342d47-605c-4646-90e0-bda29f832c6b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.681514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 935/1886] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:31.682783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51342d47-605c-4646-90e0-bda29f832c6b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.691878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51342d47-605c-4646-90e0-bda29f832c6b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.696276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fef8f5-956c-466a-8798-1bdf15015655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.696822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fef8f5-956c-466a-8798-1bdf15015655 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.697094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fef8f5-956c-466a-8798-1bdf15015655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.697362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fef8f5-956c-466a-8798-1bdf15015655 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.698076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fef8f5-956c-466a-8798-1bdf15015655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:31.698384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fef8f5-956c-466a-8798-1bdf15015655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.699903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fef8f5-956c-466a-8798-1bdf15015655 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.711408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 936/1887] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:31.712341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fef8f5-956c-466a-8798-1bdf15015655 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.722950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fef8f5-956c-466a-8798-1bdf15015655 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.727467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7b0d3-7010-41fd-8cc2-1794bc0a8160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.728020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7b0d3-7010-41fd-8cc2-1794bc0a8160 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.728297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7b0d3-7010-41fd-8cc2-1794bc0a8160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.728751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7b0d3-7010-41fd-8cc2-1794bc0a8160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.730306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7b0d3-7010-41fd-8cc2-1794bc0a8160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.731845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7b0d3-7010-41fd-8cc2-1794bc0a8160 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.741605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 937/1888] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:31.742456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7b0d3-7010-41fd-8cc2-1794bc0a8160 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.752242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7b0d3-7010-41fd-8cc2-1794bc0a8160 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.757140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef1c32-b40b-482d-af8f-42971d058375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.757729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef1c32-b40b-482d-af8f-42971d058375 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.758009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef1c32-b40b-482d-af8f-42971d058375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.758281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef1c32-b40b-482d-af8f-42971d058375 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.758879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef1c32-b40b-482d-af8f-42971d058375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.760873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef1c32-b40b-482d-af8f-42971d058375 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.787409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 952/1889] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:31.788320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aff8b4-bad0-4d25-960a-fe870d7b714e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.848412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aff8b4-bad0-4d25-960a-fe870d7b714e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:31.853138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c261f18-e7bd-4515-bc12-f283ba075764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:31.854583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c261f18-e7bd-4515-bc12-f283ba075764 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:31.854866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c261f18-e7bd-4515-bc12-f283ba075764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:31.855133 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c261f18-e7bd-4515-bc12-f283ba075764 admin admin] PATH_INFO: `/v3/projects/b29a8950bb904e2991e9e449f26c0e8b/users/f21efc411b354f019d4061dfe6c0fda4/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:31.869565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c261f18-e7bd-4515-bc12-f283ba075764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29a8950bb904e2991e9e449f26c0e8b, user_id=f21efc411b354f019d4061dfe6c0fda4, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:31.872542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c261f18-e7bd-4515-bc12-f283ba075764 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:31.878965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 938/1890] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:31.882264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef1c32-b40b-482d-af8f-42971d058375 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.946428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 953/1891] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:31 2022] PUT /identity/v3/projects/b29a8950bb904e2991e9e449f26c0e8b/users/f21efc411b354f019d4061dfe6c0fda4/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:31.947871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c261f18-e7bd-4515-bc12-f283ba075764 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:31.979370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef1c32-b40b-482d-af8f-42971d058375 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.028394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c261f18-e7bd-4515-bc12-f283ba075764 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.037971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:32.049750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279673-ef60-4faf-90ff-a704602bf3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.050549 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279673-ef60-4faf-90ff-a704602bf3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.051061 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279673-ef60-4faf-90ff-a704602bf3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.051434 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279673-ef60-4faf-90ff-a704602bf3ab admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.052746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11279673-ef60-4faf-90ff-a704602bf3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.055121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11279673-ef60-4faf-90ff-a704602bf3ab admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.066997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8f6f9-92ab-42f1-81e7-13d67d202d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.067674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f6f9-92ab-42f1-81e7-13d67d202d07 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.068095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f6f9-92ab-42f1-81e7-13d67d202d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.068591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8f6f9-92ab-42f1-81e7-13d67d202d07 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.069230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8f6f9-92ab-42f1-81e7-13d67d202d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.073675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8f6f9-92ab-42f1-81e7-13d67d202d07 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.163754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 939/1892] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:32.165715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7bd63-1cdf-40db-902b-4f100f8b5f6a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.166159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7bd63-1cdf-40db-902b-4f100f8b5f6a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.166844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7bd63-1cdf-40db-902b-4f100f8b5f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.173808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 954/1893] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:31 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:32.174655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279673-ef60-4faf-90ff-a704602bf3ab admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.198680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279673-ef60-4faf-90ff-a704602bf3ab admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.199383 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-85e7bd63-1cdf-40db-902b-4f100f8b5f6a None None] MFA Rules not processed for user `f21efc411b354f019d4061dfe6c0fda4`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:32.200697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-85e7bd63-1cdf-40db-902b-4f100f8b5f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:32.204326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3297f-bbc1-4b62-951d-cd78477f310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.205032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3297f-bbc1-4b62-951d-cd78477f310b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.205384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3297f-bbc1-4b62-951d-cd78477f310b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.206798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3297f-bbc1-4b62-951d-cd78477f310b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.206927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3297f-bbc1-4b62-951d-cd78477f310b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.208682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3297f-bbc1-4b62-951d-cd78477f310b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.222596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 955/1894] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:32.224395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3297f-bbc1-4b62-951d-cd78477f310b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.236615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3297f-bbc1-4b62-951d-cd78477f310b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.245913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c4eeb-df7e-464e-97d3-f8141c978469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.245913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c4eeb-df7e-464e-97d3-f8141c978469 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.245913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c4eeb-df7e-464e-97d3-f8141c978469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.245913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c4eeb-df7e-464e-97d3-f8141c978469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.246613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c4eeb-df7e-464e-97d3-f8141c978469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.247965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c4eeb-df7e-464e-97d3-f8141c978469 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.263962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 956/1895] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:32.265725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c4eeb-df7e-464e-97d3-f8141c978469 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.282063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c4eeb-df7e-464e-97d3-f8141c978469 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.296410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 940/1896] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:32.297745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7bd63-1cdf-40db-902b-4f100f8b5f6a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.311045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7bd63-1cdf-40db-902b-4f100f8b5f6a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.314117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70c2d7-f716-4d25-9d04-23b96469ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.314751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c2d7-f716-4d25-9d04-23b96469ed73 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.315120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c2d7-f716-4d25-9d04-23b96469ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.315308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c2d7-f716-4d25-9d04-23b96469ed73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.316086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70c2d7-f716-4d25-9d04-23b96469ed73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.317755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70c2d7-f716-4d25-9d04-23b96469ed73 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.320077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ff9ca-9b76-4443-b902-8d2545d596b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.326153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ff9ca-9b76-4443-b902-8d2545d596b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.328448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ff9ca-9b76-4443-b902-8d2545d596b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.328730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ff9ca-9b76-4443-b902-8d2545d596b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.329502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ff9ca-9b76-4443-b902-8d2545d596b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.332465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ff9ca-9b76-4443-b902-8d2545d596b6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.355061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 941/1897] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:32.359197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ff9ca-9b76-4443-b902-8d2545d596b6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.374760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 957/1898] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:32.379925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70c2d7-f716-4d25-9d04-23b96469ed73 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.392465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ff9ca-9b76-4443-b902-8d2545d596b6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.402764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70c2d7-f716-4d25-9d04-23b96469ed73 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.406433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ee2ac-b3f9-4d61-ad2a-1556c647bf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.407059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ee2ac-b3f9-4d61-ad2a-1556c647bf89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.407342 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ee2ac-b3f9-4d61-ad2a-1556c647bf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.407654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ee2ac-b3f9-4d61-ad2a-1556c647bf89 admin admin] PATH_INFO: `/v3/projects/89bf4f83f34c4e49b47691a795223775/users/126fe664eb114224b70f8ae9732fcd6b/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.426714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ee2ac-b3f9-4d61-ad2a-1556c647bf89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bf4f83f34c4e49b47691a795223775, user_id=126fe664eb114224b70f8ae9732fcd6b, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.429338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdb038-5bbb-4a5f-b495-1facb4cf29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.429561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ee2ac-b3f9-4d61-ad2a-1556c647bf89 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.430072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb038-5bbb-4a5f-b495-1facb4cf29e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.430350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb038-5bbb-4a5f-b495-1facb4cf29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.430625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdb038-5bbb-4a5f-b495-1facb4cf29e1 admin admin] PATH_INFO: `/v3/projects/b190083e4b1d4aaaa53aeec33aae2eb0/users/66e1762209264d17a71ad99ac90c2e24/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.467258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdb038-5bbb-4a5f-b495-1facb4cf29e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b190083e4b1d4aaaa53aeec33aae2eb0, user_id=66e1762209264d17a71ad99ac90c2e24, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.469960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdb038-5bbb-4a5f-b495-1facb4cf29e1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.513687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 942/1899] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:32 2022] PUT /identity/v3/projects/89bf4f83f34c4e49b47691a795223775/users/126fe664eb114224b70f8ae9732fcd6b/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:32.514669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ee2ac-b3f9-4d61-ad2a-1556c647bf89 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.522153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7f9ee2ac-b3f9-4d61-ad2a-1556c647bf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:32.582189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 958/1900] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:32 2022] PUT /identity/v3/projects/b190083e4b1d4aaaa53aeec33aae2eb0/users/66e1762209264d17a71ad99ac90c2e24/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:32.583860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65da25b-89af-42e1-857e-eec56ef8b654 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.584180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65da25b-89af-42e1-857e-eec56ef8b654 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.584410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65da25b-89af-42e1-857e-eec56ef8b654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.612039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b65da25b-89af-42e1-857e-eec56ef8b654 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:32.613281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b65da25b-89af-42e1-857e-eec56ef8b654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:32.620344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ee2ac-b3f9-4d61-ad2a-1556c647bf89 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.694906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f3b73-22bc-4d57-8206-48019df15479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.695798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f3b73-22bc-4d57-8206-48019df15479 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.697448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f3b73-22bc-4d57-8206-48019df15479 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.697448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f3b73-22bc-4d57-8206-48019df15479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.699510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 959/1901] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:32.700984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07b8fe-d5b1-4c16-88ec-3b6b4e2583ef None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.701275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07b8fe-d5b1-4c16-88ec-3b6b4e2583ef None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.701576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07b8fe-d5b1-4c16-88ec-3b6b4e2583ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.731874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1f07b8fe-d5b1-4c16-88ec-3b6b4e2583ef None None] MFA Rules not processed for user `66e1762209264d17a71ad99ac90c2e24`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:32.733137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1f07b8fe-d5b1-4c16-88ec-3b6b4e2583ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:32.758216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f3b73-22bc-4d57-8206-48019df15479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.759725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f3b73-22bc-4d57-8206-48019df15479 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.769738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 943/1902] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:32.770612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f3b73-22bc-4d57-8206-48019df15479 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.772254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-530f3b73-22bc-4d57-8206-48019df15479 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:32.807924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 960/1903] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:32.808422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07b8fe-d5b1-4c16-88ec-3b6b4e2583ef None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.819180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07b8fe-d5b1-4c16-88ec-3b6b4e2583ef None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.824764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.825561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.825837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.826179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] PATH_INFO: `/v3/users/f21efc411b354f019d4061dfe6c0fda4` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.827479 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21efc411b354f019d4061dfe6c0fda4)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.829149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.838245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f3b73-22bc-4d57-8206-48019df15479 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.841881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36574f36-05a7-4b9a-ae32-061c60c4ae31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.842714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574f36-05a7-4b9a-ae32-061c60c4ae31 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.843041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574f36-05a7-4b9a-ae32-061c60c4ae31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.843314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574f36-05a7-4b9a-ae32-061c60c4ae31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.853521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36574f36-05a7-4b9a-ae32-061c60c4ae31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.855952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36574f36-05a7-4b9a-ae32-061c60c4ae31 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.865811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 944/1904] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:32.867877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36574f36-05a7-4b9a-ae32-061c60c4ae31 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:32.879523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36574f36-05a7-4b9a-ae32-061c60c4ae31 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:32.884587 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae8373-e6e8-454c-b46b-0da674e99cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:32.885514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae8373-e6e8-454c-b46b-0da674e99cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:32.885711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae8373-e6e8-454c-b46b-0da674e99cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:32.885986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae8373-e6e8-454c-b46b-0da674e99cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:32.886617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae8373-e6e8-454c-b46b-0da674e99cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:32.888657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae8373-e6e8-454c-b46b-0da674e99cdc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:32.999295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 945/1905] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:33.002951 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae8373-e6e8-454c-b46b-0da674e99cdc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:33.065679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21efc411b354f019d4061dfe6c0fda4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:33.066600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21efc411b354f019d4061dfe6c0fda4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:33.067331 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21efc411b354f019d4061dfe6c0fda4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:33.109805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae8373-e6e8-454c-b46b-0da674e99cdc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:33.121319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e56d1e-ddba-4e93-90b8-6ff24cb7de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:33.122472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e56d1e-ddba-4e93-90b8-6ff24cb7de96 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:33.123180 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e56d1e-ddba-4e93-90b8-6ff24cb7de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:33.123386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e56d1e-ddba-4e93-90b8-6ff24cb7de96 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:33.124618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e56d1e-ddba-4e93-90b8-6ff24cb7de96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:33.128291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e56d1e-ddba-4e93-90b8-6ff24cb7de96 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:33.180640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21efc411b354f019d4061dfe6c0fda4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:33.204997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4b4e5ed5-2367-478b-a2dd-7fddfbd8f380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21efc411b354f019d4061dfe6c0fda4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:33.226989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 961/1906] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:32 2022] DELETE /identity/v3/users/f21efc411b354f019d4061dfe6c0fda4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:33.233153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b3e53-f65e-4b88-98d5-0dfe2a29f405 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:33.233450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b3e53-f65e-4b88-98d5-0dfe2a29f405 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:33.233736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b3e53-f65e-4b88-98d5-0dfe2a29f405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:33.250861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 946/1907] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:33 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:33.258824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e56d1e-ddba-4e93-90b8-6ff24cb7de96 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:33.260922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-84e56d1e-ddba-4e93-90b8-6ff24cb7de96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:33.267077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5d7b3e53-f65e-4b88-98d5-0dfe2a29f405 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:33.268370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5d7b3e53-f65e-4b88-98d5-0dfe2a29f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:33.292247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e56d1e-ddba-4e93-90b8-6ff24cb7de96 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:33.380652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ae128-afd9-48ca-9c34-b83563a2a743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:33.381409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ae128-afd9-48ca-9c34-b83563a2a743 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:33.381814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ae128-afd9-48ca-9c34-b83563a2a743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:33.382495 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ae128-afd9-48ca-9c34-b83563a2a743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:33.383457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ae128-afd9-48ca-9c34-b83563a2a743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:33.385222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ae128-afd9-48ca-9c34-b83563a2a743 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:33.391582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 962/1908] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:33.402780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 947/1909] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:33.403215 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b3e53-f65e-4b88-98d5-0dfe2a29f405 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:33.411061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ae128-afd9-48ca-9c34-b83563a2a743 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:33.411199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5d7b3e53-f65e-4b88-98d5-0dfe2a29f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:33.415613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ae128-afd9-48ca-9c34-b83563a2a743 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:33.422517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af198734-2a9d-4dbc-b830-17538d169771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:33.423390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198734-2a9d-4dbc-b830-17538d169771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:33.423718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198734-2a9d-4dbc-b830-17538d169771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:33.424028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af198734-2a9d-4dbc-b830-17538d169771 admin admin] PATH_INFO: `/v3/projects/f6119d83a63d444699ddbc9a839928b8/users/e7fdd5d0e2b641c895704f5238bda3e0/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:33.441238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af198734-2a9d-4dbc-b830-17538d169771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6119d83a63d444699ddbc9a839928b8, user_id=e7fdd5d0e2b641c895704f5238bda3e0, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:33.443623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af198734-2a9d-4dbc-b830-17538d169771 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:33.483976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b3e53-f65e-4b88-98d5-0dfe2a29f405 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:33.487833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dccab7-2fed-4556-b46c-c6212dac08f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:33.488464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dccab7-2fed-4556-b46c-c6212dac08f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:33.488742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dccab7-2fed-4556-b46c-c6212dac08f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:33.489008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dccab7-2fed-4556-b46c-c6212dac08f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:33.498433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dccab7-2fed-4556-b46c-c6212dac08f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:33.499858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dccab7-2fed-4556-b46c-c6212dac08f2 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:33.510862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 963/1910] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:33.605768 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 948/1911] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:33 2022] PUT /identity/v3/projects/f6119d83a63d444699ddbc9a839928b8/users/e7fdd5d0e2b641c895704f5238bda3e0/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:33.610023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dccab7-2fed-4556-b46c-c6212dac08f2 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:33.620610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dccab7-2fed-4556-b46c-c6212dac08f2 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:33.702603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beef2b-2bd0-42a1-8f16-7bfe0c3375f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:33.703578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beef2b-2bd0-42a1-8f16-7bfe0c3375f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:33.704021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beef2b-2bd0-42a1-8f16-7bfe0c3375f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:33.704644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beef2b-2bd0-42a1-8f16-7bfe0c3375f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:33.705599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beef2b-2bd0-42a1-8f16-7bfe0c3375f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:33.708626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beef2b-2bd0-42a1-8f16-7bfe0c3375f0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:33.720172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 964/1912] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:33.730431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af198734-2a9d-4dbc-b830-17538d169771 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:33.744855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af198734-2a9d-4dbc-b830-17538d169771 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:33.749326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:33.765118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7742bc1-ce28-40dd-9e9e-4ecbadf27dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:33.773273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7742bc1-ce28-40dd-9e9e-4ecbadf27dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:33.773273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7742bc1-ce28-40dd-9e9e-4ecbadf27dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:33.773273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7742bc1-ce28-40dd-9e9e-4ecbadf27dd9 admin admin] PATH_INFO: `/v3/projects/f6119d83a63d444699ddbc9a839928b8/users/e7fdd5d0e2b641c895704f5238bda3e0/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:33.773273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7742bc1-ce28-40dd-9e9e-4ecbadf27dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6119d83a63d444699ddbc9a839928b8, user_id=e7fdd5d0e2b641c895704f5238bda3e0, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:33.777263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7742bc1-ce28-40dd-9e9e-4ecbadf27dd9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:33.786486 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:33.795059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 949/1913] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:33 2022] PUT /identity/v3/projects/f6119d83a63d444699ddbc9a839928b8/users/e7fdd5d0e2b641c895704f5238bda3e0/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:33.805312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cb778-07b3-4f2c-9f68-5d8bd9e7cb8c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:33.805767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cb778-07b3-4f2c-9f68-5d8bd9e7cb8c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:33.805893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cb778-07b3-4f2c-9f68-5d8bd9e7cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:33.843329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-784cb778-07b3-4f2c-9f68-5d8bd9e7cb8c None None] MFA Rules not processed for user `e7fdd5d0e2b641c895704f5238bda3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:33.844225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-784cb778-07b3-4f2c-9f68-5d8bd9e7cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:33.924844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 965/1914] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:33.938150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7742bc1-ce28-40dd-9e9e-4ecbadf27dd9 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:33.941782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c7742bc1-ce28-40dd-9e9e-4ecbadf27dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:34.002744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7742bc1-ce28-40dd-9e9e-4ecbadf27dd9 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:34.006885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34f0fa-a97d-4343-b3ab-5a4d74bdd05b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:34.007520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34f0fa-a97d-4343-b3ab-5a4d74bdd05b service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.007798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34f0fa-a97d-4343-b3ab-5a4d74bdd05b service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.008093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34f0fa-a97d-4343-b3ab-5a4d74bdd05b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.018082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34f0fa-a97d-4343-b3ab-5a4d74bdd05b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:34.019742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34f0fa-a97d-4343-b3ab-5a4d74bdd05b service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:34.032490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 950/1915] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:34.059622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cb778-07b3-4f2c-9f68-5d8bd9e7cb8c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:34.061178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-784cb778-07b3-4f2c-9f68-5d8bd9e7cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:34.126576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34f0fa-a97d-4343-b3ab-5a4d74bdd05b service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:34.226218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cb778-07b3-4f2c-9f68-5d8bd9e7cb8c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:34.236052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:34.237906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.238378 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.238860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] PATH_INFO: `/v3/projects/b29a8950bb904e2991e9e449f26c0e8b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.242141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29a8950bb904e2991e9e449f26c0e8b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:34.246178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:34.284962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34f0fa-a97d-4343-b3ab-5a4d74bdd05b service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:34.290186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:34.290828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.291148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.291422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] PATH_INFO: `/v3/users/66e1762209264d17a71ad99ac90c2e24` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.292996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e1762209264d17a71ad99ac90c2e24)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:34.294712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:34.413586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29a8950bb904e2991e9e449f26c0e8b', 'request_id': 'req-a00b9feb-a80f-4910-b44f-6955c59536f3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.419153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29a8950bb904e2991e9e449f26c0e8b', 'request_id': 'req-a00b9feb-a80f-4910-b44f-6955c59536f3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.425985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29a8950bb904e2991e9e449f26c0e8b', 'request_id': 'req-a00b9feb-a80f-4910-b44f-6955c59536f3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.496999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e1762209264d17a71ad99ac90c2e24'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.507234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] The token cache is being invalidate because project b29a8950bb904e2991e9e449f26c0e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:34.507675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.508481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a00b9feb-a80f-4910-b44f-6955c59536f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.511300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 966/1916] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:34 2022] DELETE /identity/v3/projects/b29a8950bb904e2991e9e449f26c0e8b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:34.512033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e1762209264d17a71ad99ac90c2e24'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.512747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e1762209264d17a71ad99ac90c2e24'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.513356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e1762209264d17a71ad99ac90c2e24'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.515906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46f6b8-219e-4380-8090-270cbc1d1df7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.516739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46f6b8-219e-4380-8090-270cbc1d1df7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.516739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46f6b8-219e-4380-8090-270cbc1d1df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.537989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-de46f6b8-219e-4380-8090-270cbc1d1df7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:34.539243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-de46f6b8-219e-4380-8090-270cbc1d1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:34.597676 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-979c82a8-c79e-4fa6-8dde-0275f330fbff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e1762209264d17a71ad99ac90c2e24'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:34.621457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 967/1917] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:34.633414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2e7a-85d1-4f2c-bc3d-754c4ac3c34d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.633731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2e7a-85d1-4f2c-bc3d-754c4ac3c34d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.634059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2e7a-85d1-4f2c-bc3d-754c4ac3c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.650257 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 951/1918] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:34 2022] DELETE /identity/v3/users/66e1762209264d17a71ad99ac90c2e24 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:34.663635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da5fc-2dc1-4237-916b-68935d984e31 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.666082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da5fc-2dc1-4237-916b-68935d984e31 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.666936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da5fc-2dc1-4237-916b-68935d984e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.676914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d28a2e7a-85d1-4f2c-bc3d-754c4ac3c34d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:34.678317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d28a2e7a-85d1-4f2c-bc3d-754c4ac3c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:34.695943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fb5da5fc-2dc1-4237-916b-68935d984e31 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:34.697945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fb5da5fc-2dc1-4237-916b-68935d984e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:34.771712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 968/1919] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:34.774790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a2e7a-85d1-4f2c-bc3d-754c4ac3c34d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:34.787401 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a2e7a-85d1-4f2c-bc3d-754c4ac3c34d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:34.794311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:34.795108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.795597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.795992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.796751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:34.805514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:34.805514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:34.818516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 952/1920] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:34.819961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d4474-b757-4345-95c0-b0244f560b2f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.820253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d4474-b757-4345-95c0-b0244f560b2f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.820525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d4474-b757-4345-95c0-b0244f560b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.835752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 969/1921] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:34.837218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:34.840299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:34.867889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f45d4474-b757-4345-95c0-b0244f560b2f None None] MFA Rules not processed for user `126fe664eb114224b70f8ae9732fcd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:34.870082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f45d4474-b757-4345-95c0-b0244f560b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:34.936138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd049-3578-4c83-94de-52a8f46555e8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:34.940694 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b0b85-3f69-46bc-aca1-4ca1d9f6e6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:34.942169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0b85-3f69-46bc-aca1-4ca1d9f6e6de service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.942561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0b85-3f69-46bc-aca1-4ca1d9f6e6de service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.942915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b0b85-3f69-46bc-aca1-4ca1d9f6e6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.960332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 953/1922] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:34.965701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d4474-b757-4345-95c0-b0244f560b2f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:34.966005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b0b85-3f69-46bc-aca1-4ca1d9f6e6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:34.966005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b0b85-3f69-46bc-aca1-4ca1d9f6e6de service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:34.977275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d4474-b757-4345-95c0-b0244f560b2f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:34.993662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75ed09-c3a1-46b1-8cce-937cb892a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:34.995042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75ed09-c3a1-46b1-8cce-937cb892a3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:34.995482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75ed09-c3a1-46b1-8cce-937cb892a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:34.996315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75ed09-c3a1-46b1-8cce-937cb892a3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:34.997359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75ed09-c3a1-46b1-8cce-937cb892a3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:35.000115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75ed09-c3a1-46b1-8cce-937cb892a3f4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:35.013536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 970/1923] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:35.014257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b0b85-3f69-46bc-aca1-4ca1d9f6e6de service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:35.022631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-229b0b85-3f69-46bc-aca1-4ca1d9f6e6de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:35.118624 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b0b85-3f69-46bc-aca1-4ca1d9f6e6de service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:35.123344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cac2a6-c62d-4572-9f6d-4def8009320f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:35.123958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cac2a6-c62d-4572-9f6d-4def8009320f service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:35.124230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cac2a6-c62d-4572-9f6d-4def8009320f service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:35.124496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cac2a6-c62d-4572-9f6d-4def8009320f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:35.133010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 954/1924] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:34 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:35.137335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75ed09-c3a1-46b1-8cce-937cb892a3f4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:35.138545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cac2a6-c62d-4572-9f6d-4def8009320f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:35.140140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cac2a6-c62d-4572-9f6d-4def8009320f service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:35.150252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 971/1925] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:35.234162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75ed09-c3a1-46b1-8cce-937cb892a3f4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:35.239734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4d3b6-73be-437d-b444-4e57924e7b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:35.239734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4d3b6-73be-437d-b444-4e57924e7b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:35.239734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4d3b6-73be-437d-b444-4e57924e7b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:35.239734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4d3b6-73be-437d-b444-4e57924e7b53 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:35.240893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4d3b6-73be-437d-b444-4e57924e7b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:35.245087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4d3b6-73be-437d-b444-4e57924e7b53 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:35.256761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:35.299682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:35.341620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 955/1926] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:35 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:35.345712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cac2a6-c62d-4572-9f6d-4def8009320f service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:35.362110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cac2a6-c62d-4572-9f6d-4def8009320f service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:35.371511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05651c97-4b08-4051-9b7a-c06f005e8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:35.372323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05651c97-4b08-4051-9b7a-c06f005e8c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:35.376169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05651c97-4b08-4051-9b7a-c06f005e8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:35.376169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05651c97-4b08-4051-9b7a-c06f005e8c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:35.376169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05651c97-4b08-4051-9b7a-c06f005e8c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:35.376169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05651c97-4b08-4051-9b7a-c06f005e8c0b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:35.393627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 972/1927] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:35.397000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4d3b6-73be-437d-b444-4e57924e7b53 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:35.413296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4d3b6-73be-437d-b444-4e57924e7b53 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:35.421166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5f6f-d1d4-40fa-bce7-4a73d430dc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:35.421948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5f6f-d1d4-40fa-bce7-4a73d430dc70 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:35.422308 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5f6f-d1d4-40fa-bce7-4a73d430dc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:35.422702 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5f6f-d1d4-40fa-bce7-4a73d430dc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:35.423433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5f6f-d1d4-40fa-bce7-4a73d430dc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:35.426190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5f6f-d1d4-40fa-bce7-4a73d430dc70 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:35.453974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 956/1928] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:35.456438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05651c97-4b08-4051-9b7a-c06f005e8c0b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:35.470852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05651c97-4b08-4051-9b7a-c06f005e8c0b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:35.475394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b806b9b-f8aa-4ed3-bf53-1a034cc16f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:35.476057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b806b9b-f8aa-4ed3-bf53-1a034cc16f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:35.476388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b806b9b-f8aa-4ed3-bf53-1a034cc16f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:35.476602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b806b9b-f8aa-4ed3-bf53-1a034cc16f6c admin admin] PATH_INFO: `/v3/projects/38e1fe60e24f4434948240674528a43c/users/6b5dfd0117bc4bac8dc1a7a59ceaf9ea/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:35.495629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b806b9b-f8aa-4ed3-bf53-1a034cc16f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e1fe60e24f4434948240674528a43c, user_id=6b5dfd0117bc4bac8dc1a7a59ceaf9ea, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:35.498525 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b806b9b-f8aa-4ed3-bf53-1a034cc16f6c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:35.555487 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5f6f-d1d4-40fa-bce7-4a73d430dc70 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:35.561081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b3eb5f6f-d1d4-40fa-bce7-4a73d430dc70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:35.587317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5f6f-d1d4-40fa-bce7-4a73d430dc70 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:35.594441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:35.595110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:35.595291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:35.595621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] PATH_INFO: `/v3/projects/b190083e4b1d4aaaa53aeec33aae2eb0` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:35.596726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b190083e4b1d4aaaa53aeec33aae2eb0)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:35.598961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:35.610948 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 973/1929] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:35 2022] PUT /identity/v3/projects/38e1fe60e24f4434948240674528a43c/users/6b5dfd0117bc4bac8dc1a7a59ceaf9ea/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:35.621353 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd709e3f-6721-4286-967a-b4967ad01ceb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:35.621777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd709e3f-6721-4286-967a-b4967ad01ceb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:35.622099 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd709e3f-6721-4286-967a-b4967ad01ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:35.655176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-cd709e3f-6721-4286-967a-b4967ad01ceb None None] MFA Rules not processed for user `6b5dfd0117bc4bac8dc1a7a59ceaf9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:35.656538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cd709e3f-6721-4286-967a-b4967ad01ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:35.725200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 974/1930] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:35.736559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd709e3f-6721-4286-967a-b4967ad01ceb None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:35.738009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cd709e3f-6721-4286-967a-b4967ad01ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:35.779979 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b190083e4b1d4aaaa53aeec33aae2eb0', 'request_id': 'req-1485d643-616d-46c2-a2f9-8c37c298d520'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:35.785689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b190083e4b1d4aaaa53aeec33aae2eb0', 'request_id': 'req-1485d643-616d-46c2-a2f9-8c37c298d520'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:35.792742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b190083e4b1d4aaaa53aeec33aae2eb0', 'request_id': 'req-1485d643-616d-46c2-a2f9-8c37c298d520'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:35.816923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd709e3f-6721-4286-967a-b4967ad01ceb None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:35.865034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca567c-4ddb-48d4-b58d-5558fe9f546d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79bb81300cff46b7ba1680eedf2762cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:35.865677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca567c-4ddb-48d4-b58d-5558fe9f546d service glance] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:35.865957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca567c-4ddb-48d4-b58d-5558fe9f546d service glance] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:35.866228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca567c-4ddb-48d4-b58d-5558fe9f546d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:35.876626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] The token cache is being invalidate because project b190083e4b1d4aaaa53aeec33aae2eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:35.876922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:35.877628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:35.879570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 957/1931] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:35 2022] DELETE /identity/v3/projects/b190083e4b1d4aaaa53aeec33aae2eb0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:35.883512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:35.884790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:35.925812 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca567c-4ddb-48d4-b58d-5558fe9f546d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:35.927796 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca567c-4ddb-48d4-b58d-5558fe9f546d service glance] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:35.938039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 975/1932] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:35.966250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485d643-616d-46c2-a2f9-8c37c298d520 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:35.968116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:35.968770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:35.969049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:35.969321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] PATH_INFO: `/v3/users/e7fdd5d0e2b641c895704f5238bda3e0` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:35.970522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fdd5d0e2b641c895704f5238bda3e0)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:35.972480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:36.086623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca567c-4ddb-48d4-b58d-5558fe9f546d service glance] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:36.086623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-34ca567c-4ddb-48d4-b58d-5558fe9f546d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:36.103154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca567c-4ddb-48d4-b58d-5558fe9f546d service glance] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:36.108708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:36.109670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:36.109946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:36.110213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] PATH_INFO: `/v3/users/1e9b2e05074e4e189726c0f319475e19` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:36.115251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9b2e05074e4e189726c0f319475e19)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:36.115251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:36.196795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fdd5d0e2b641c895704f5238bda3e0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.204997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fdd5d0e2b641c895704f5238bda3e0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.206350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fdd5d0e2b641c895704f5238bda3e0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.207831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fdd5d0e2b641c895704f5238bda3e0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.271291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-00aa5af9-63a0-4346-ae4c-05ac1ff02de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fdd5d0e2b641c895704f5238bda3e0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.294126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9b2e05074e4e189726c0f319475e19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.294962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9b2e05074e4e189726c0f319475e19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.295571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9b2e05074e4e189726c0f319475e19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.300416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 958/1933] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:35 2022] DELETE /identity/v3/users/e7fdd5d0e2b641c895704f5238bda3e0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:36.368217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9b2e05074e4e189726c0f319475e19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.384051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9b2e05074e4e189726c0f319475e19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:36.399036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 976/1934] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:36 2022] DELETE /identity/v3/users/1e9b2e05074e4e189726c0f319475e19 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:36.404103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251859bc-4903-4314-bcca-91060680655d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:36.404573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251859bc-4903-4314-bcca-91060680655d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:36.404682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251859bc-4903-4314-bcca-91060680655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:36.426985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-251859bc-4903-4314-bcca-91060680655d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:36.428182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-251859bc-4903-4314-bcca-91060680655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:36.504095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 959/1935] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:36.514562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:36.516250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:36.596916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a780ac-3b4b-4c05-949c-cd78bd18811a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:36.604181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69ed83-b04d-42f9-8ac0-913d90a43be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:36.604181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ed83-b04d-42f9-8ac0-913d90a43be1 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:36.604181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ed83-b04d-42f9-8ac0-913d90a43be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:36.604181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ed83-b04d-42f9-8ac0-913d90a43be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:36.615755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69ed83-b04d-42f9-8ac0-913d90a43be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:36.617686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69ed83-b04d-42f9-8ac0-913d90a43be1 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:36.630398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 977/1936] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:36.847987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:36.925132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:37.098408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aba76-5a3c-4cef-b369-0093e1a2dbc8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:37.098980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aba76-5a3c-4cef-b369-0093e1a2dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:37.099461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aba76-5a3c-4cef-b369-0093e1a2dbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:37.121776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b88aba76-5a3c-4cef-b369-0093e1a2dbc8 None None] MFA Rules not processed for user `126fe664eb114224b70f8ae9732fcd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:37.123381 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b88aba76-5a3c-4cef-b369-0093e1a2dbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:37.188840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 960/1937] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:37.291751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69ed83-b04d-42f9-8ac0-913d90a43be1 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:37.293506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5a69ed83-b04d-42f9-8ac0-913d90a43be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:37.307401 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69ed83-b04d-42f9-8ac0-913d90a43be1 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:37.315558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:37.315558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:37.315558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:37.315558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] PATH_INFO: `/v3/projects/20af047259104c09ac43c45dc7dba4ce` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:37.324207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20af047259104c09ac43c45dc7dba4ce)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:37.326362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:37.403199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:37.454178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20af047259104c09ac43c45dc7dba4ce', 'request_id': 'req-afeed69f-1112-43e2-963a-8558a3195012'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:37.460166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20af047259104c09ac43c45dc7dba4ce', 'request_id': 'req-afeed69f-1112-43e2-963a-8558a3195012'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:37.466791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20af047259104c09ac43c45dc7dba4ce', 'request_id': 'req-afeed69f-1112-43e2-963a-8558a3195012'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:37.560075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] The token cache is being invalidate because project 20af047259104c09ac43c45dc7dba4ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:37.560571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:37.562021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:37.564993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aba76-5a3c-4cef-b369-0093e1a2dbc8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:37.566448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b88aba76-5a3c-4cef-b369-0093e1a2dbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:37.570858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 978/1938] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:37 2022] DELETE /identity/v3/projects/20af047259104c09ac43c45dc7dba4ce => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:37.576386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:37.587494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:37.597198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aba76-5a3c-4cef-b369-0093e1a2dbc8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:37.701491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:37.702502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:37.702885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:37.703232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] PATH_INFO: `/v3/projects/f6119d83a63d444699ddbc9a839928b8` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:37.704500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6119d83a63d444699ddbc9a839928b8)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:37.707007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:37.734768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed69f-1112-43e2-963a-8558a3195012 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:37.760960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:37.763787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:37.764238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:37.764982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] PATH_INFO: `/v3/users/733a58387db64ef28fda170367c6c1c3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:37.772108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=733a58387db64ef28fda170367c6c1c3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:37.780340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:37.929494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6119d83a63d444699ddbc9a839928b8', 'request_id': 'req-ee82f1f8-a15f-4180-831b-7445a9dff776'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:37.955745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6119d83a63d444699ddbc9a839928b8', 'request_id': 'req-ee82f1f8-a15f-4180-831b-7445a9dff776'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:37.972249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6119d83a63d444699ddbc9a839928b8', 'request_id': 'req-ee82f1f8-a15f-4180-831b-7445a9dff776'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:38.026504 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '733a58387db64ef28fda170367c6c1c3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:38.027330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '733a58387db64ef28fda170367c6c1c3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:38.027935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '733a58387db64ef28fda170367c6c1c3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:38.130986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] The token cache is being invalidate because project f6119d83a63d444699ddbc9a839928b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:38.131280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:38.132068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee82f1f8-a15f-4180-831b-7445a9dff776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:38.138462 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 961/1939] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:37 2022] DELETE /identity/v3/projects/f6119d83a63d444699ddbc9a839928b8 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:38.140258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec902-a3e0-413c-a85c-43e16bb95f70 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:38.141017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec902-a3e0-413c-a85c-43e16bb95f70 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:38.141017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec902-a3e0-413c-a85c-43e16bb95f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:38.202403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-70dec902-a3e0-413c-a85c-43e16bb95f70 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:38.204068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '733a58387db64ef28fda170367c6c1c3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:38.205942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-70dec902-a3e0-413c-a85c-43e16bb95f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:38.232117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-77ccb5ae-101b-4dc0-b0d6-325c934f0877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '733a58387db64ef28fda170367c6c1c3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:38.248721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 979/1940] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:37 2022] DELETE /identity/v3/users/733a58387db64ef28fda170367c6c1c3 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:38.312618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 962/1941] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:38.314508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f5e6-0347-4ad1-8bc4-c17ac5e831d7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:38.316012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f5e6-0347-4ad1-8bc4-c17ac5e831d7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:38.316012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f5e6-0347-4ad1-8bc4-c17ac5e831d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:38.401431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9751f5e6-0347-4ad1-8bc4-c17ac5e831d7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:38.401431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9751f5e6-0347-4ad1-8bc4-c17ac5e831d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:38.544124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 980/1942] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:38.544715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dec902-a3e0-413c-a85c-43e16bb95f70 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:38.554948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dec902-a3e0-413c-a85c-43e16bb95f70 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:38.563096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f206db1-da25-4f4d-98a2-cd56d434e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:38.564164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f206db1-da25-4f4d-98a2-cd56d434e952 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:38.564447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f206db1-da25-4f4d-98a2-cd56d434e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:38.564756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f206db1-da25-4f4d-98a2-cd56d434e952 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:38.565523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f206db1-da25-4f4d-98a2-cd56d434e952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:38.566981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f206db1-da25-4f4d-98a2-cd56d434e952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:38.568367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f206db1-da25-4f4d-98a2-cd56d434e952 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:38.585916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 963/1943] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:38.599037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f5e6-0347-4ad1-8bc4-c17ac5e831d7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:38.629405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f5e6-0347-4ad1-8bc4-c17ac5e831d7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:38.636745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4d478-d5bb-481d-9a7f-c91762f98b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:38.638128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4d478-d5bb-481d-9a7f-c91762f98b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:38.638556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4d478-d5bb-481d-9a7f-c91762f98b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:38.638998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4d478-d5bb-481d-9a7f-c91762f98b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:38.639780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4d478-d5bb-481d-9a7f-c91762f98b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:38.641980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4d478-d5bb-481d-9a7f-c91762f98b99 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:38.829493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 981/1944] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:38 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:38.833207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f206db1-da25-4f4d-98a2-cd56d434e952 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:38.850414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f206db1-da25-4f4d-98a2-cd56d434e952 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:38.865633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:38.949689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4d478-d5bb-481d-9a7f-c91762f98b99 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:38.949689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e3f4d478-d5bb-481d-9a7f-c91762f98b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:38.973376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc05e-f7cf-4469-920a-576128bd25b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:38.974039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc05e-f7cf-4469-920a-576128bd25b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:38.974323 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc05e-f7cf-4469-920a-576128bd25b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:38.976358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebc05e-f7cf-4469-920a-576128bd25b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:38.976358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc05e-f7cf-4469-920a-576128bd25b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:38.977850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebc05e-f7cf-4469-920a-576128bd25b3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.030905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4d478-d5bb-481d-9a7f-c91762f98b99 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:39.036342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:39.036961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.037271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.037575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] PATH_INFO: `/v3/projects/64f9732f5f92418ab9aeaa09b5ea4ce8` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.038793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f9732f5f92418ab9aeaa09b5ea4ce8)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:39.040711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.065336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 964/1945] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:38 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:39.066386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc05e-f7cf-4469-920a-576128bd25b3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.077697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebc05e-f7cf-4469-920a-576128bd25b3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:39.082302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b4ad5-a75b-406c-8702-b5aaa94b606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:39.082891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4ad5-a75b-406c-8702-b5aaa94b606d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.083170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4ad5-a75b-406c-8702-b5aaa94b606d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.085659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4ad5-a75b-406c-8702-b5aaa94b606d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.085659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b4ad5-a75b-406c-8702-b5aaa94b606d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:39.085847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b4ad5-a75b-406c-8702-b5aaa94b606d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.096931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 965/1946] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:03:39.100596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b4ad5-a75b-406c-8702-b5aaa94b606d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.110923 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b4ad5-a75b-406c-8702-b5aaa94b606d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:39.115579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817f0b8-4345-40ef-b1c5-a83192d707f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:39.118191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817f0b8-4345-40ef-b1c5-a83192d707f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.118191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817f0b8-4345-40ef-b1c5-a83192d707f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.118191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817f0b8-4345-40ef-b1c5-a83192d707f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.118191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817f0b8-4345-40ef-b1c5-a83192d707f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:39.119076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817f0b8-4345-40ef-b1c5-a83192d707f7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.130190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 966/1947] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:03:39.134005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817f0b8-4345-40ef-b1c5-a83192d707f7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.163541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817f0b8-4345-40ef-b1c5-a83192d707f7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:39.172692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f9732f5f92418ab9aeaa09b5ea4ce8', 'request_id': 'req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:39.180884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f9732f5f92418ab9aeaa09b5ea4ce8', 'request_id': 'req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:39.190498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f9732f5f92418ab9aeaa09b5ea4ce8', 'request_id': 'req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:39.255572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd62335-f666-45f6-908d-8881e41d9457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:39.256366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd62335-f666-45f6-908d-8881e41d9457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.256701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd62335-f666-45f6-908d-8881e41d9457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.257042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd62335-f666-45f6-908d-8881e41d9457 admin admin] PATH_INFO: `/v3/projects/bfd189fdae7e468d84db26864c28f9e7/users/c8b7b0ccc5e64012bc390cc136127a7b/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.265704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] The token cache is being invalidate because project 64f9732f5f92418ab9aeaa09b5ea4ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:39.265996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:39.266673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15fd4152-cfea-41a9-b0b0-f0bff1a7e2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:39.268532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 982/1948] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:38 2022] DELETE /identity/v3/projects/64f9732f5f92418ab9aeaa09b5ea4ce8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:39.285527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd62335-f666-45f6-908d-8881e41d9457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd189fdae7e468d84db26864c28f9e7, user_id=c8b7b0ccc5e64012bc390cc136127a7b, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:39.288449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd62335-f666-45f6-908d-8881e41d9457 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.298806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc308-882d-46a2-8334-9f4e1ddde324 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.299108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc308-882d-46a2-8334-9f4e1ddde324 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.299369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bc308-882d-46a2-8334-9f4e1ddde324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.329454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-949bc308-882d-46a2-8334-9f4e1ddde324 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:39.330714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-949bc308-882d-46a2-8334-9f4e1ddde324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:39.339413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 983/1949] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:39.347163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043b98f-9877-4bd2-956c-da013aee7ead None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.347446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043b98f-9877-4bd2-956c-da013aee7ead None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.347722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043b98f-9877-4bd2-956c-da013aee7ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.367531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9043b98f-9877-4bd2-956c-da013aee7ead None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:39.370809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9043b98f-9877-4bd2-956c-da013aee7ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:39.376951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 984/1950] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:39.381699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043b98f-9877-4bd2-956c-da013aee7ead None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.391154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043b98f-9877-4bd2-956c-da013aee7ead None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:39.398267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 967/1951] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:39 2022] PUT /identity/v3/projects/bfd189fdae7e468d84db26864c28f9e7/users/c8b7b0ccc5e64012bc390cc136127a7b/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:39.419996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5029d-11c0-43fc-a1b0-a326b6f940d0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.420567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5029d-11c0-43fc-a1b0-a326b6f940d0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.421231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5029d-11c0-43fc-a1b0-a326b6f940d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.457504 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53f07-deb7-430d-9563-6a8cebd9a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:39.458281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53f07-deb7-430d-9563-6a8cebd9a6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.458729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53f07-deb7-430d-9563-6a8cebd9a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.459012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db53f07-deb7-430d-9563-6a8cebd9a6e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.459678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53f07-deb7-430d-9563-6a8cebd9a6e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:39.460323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53f07-deb7-430d-9563-6a8cebd9a6e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:39.461777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db53f07-deb7-430d-9563-6a8cebd9a6e2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.462314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7fb5029d-11c0-43fc-a1b0-a326b6f940d0 None None] MFA Rules not processed for user `c8b7b0ccc5e64012bc390cc136127a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:39.464452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7fb5029d-11c0-43fc-a1b0-a326b6f940d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:39.476590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 985/1952] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:03:39.491567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53f07-deb7-430d-9563-6a8cebd9a6e2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.511745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:39.518566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db53f07-deb7-430d-9563-6a8cebd9a6e2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:39.525995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746472db-21c9-454b-a16e-8481a96877cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:39.526823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746472db-21c9-454b-a16e-8481a96877cf admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.527106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746472db-21c9-454b-a16e-8481a96877cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.527653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746472db-21c9-454b-a16e-8481a96877cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.528791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746472db-21c9-454b-a16e-8481a96877cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:39.532551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746472db-21c9-454b-a16e-8481a96877cf admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.597687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 968/1953] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:39.613752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5029d-11c0-43fc-a1b0-a326b6f940d0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.616587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 986/1954] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:39 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:39.621294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7fb5029d-11c0-43fc-a1b0-a326b6f940d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:39.622250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746472db-21c9-454b-a16e-8481a96877cf admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.650420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5029d-11c0-43fc-a1b0-a326b6f940d0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:39.717790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746472db-21c9-454b-a16e-8481a96877cf admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:39.723112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd78062-ded7-4543-841b-a474376c6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:39.723890 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd78062-ded7-4543-841b-a474376c6e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.724170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd78062-ded7-4543-841b-a474376c6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.724506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd78062-ded7-4543-841b-a474376c6e78 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.725203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd78062-ded7-4543-841b-a474376c6e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:39.727324 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd78062-ded7-4543-841b-a474376c6e78 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.731871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4e598-4e7d-4a6a-a310-6a57a9b9ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:39.732490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4e598-4e7d-4a6a-a310-6a57a9b9ef4b admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.732959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4e598-4e7d-4a6a-a310-6a57a9b9ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.733378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4e598-4e7d-4a6a-a310-6a57a9b9ef4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.734395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4e598-4e7d-4a6a-a310-6a57a9b9ef4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:39.736597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4e598-4e7d-4a6a-a310-6a57a9b9ef4b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.860742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 987/1955] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:39 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:39.865853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd78062-ded7-4543-841b-a474376c6e78 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.877713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd78062-ded7-4543-841b-a474376c6e78 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:39.891634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 969/1956] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:39 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:39.893267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f517f-38ae-4693-8665-6d3e80200848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:39.894190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f517f-38ae-4693-8665-6d3e80200848 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:39.895279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4e598-4e7d-4a6a-a310-6a57a9b9ef4b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.896130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f517f-38ae-4693-8665-6d3e80200848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:39.896964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f517f-38ae-4693-8665-6d3e80200848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:39.903333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f517f-38ae-4693-8665-6d3e80200848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:39.905513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f517f-38ae-4693-8665-6d3e80200848 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:39.936424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 988/1957] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:39.942064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f517f-38ae-4693-8665-6d3e80200848 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:39.967147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f517f-38ae-4693-8665-6d3e80200848 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.008814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4e598-4e7d-4a6a-a310-6a57a9b9ef4b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.017882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d6a27-2e54-41fc-95f0-67cf0c63060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.018663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d6a27-2e54-41fc-95f0-67cf0c63060c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.019130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d6a27-2e54-41fc-95f0-67cf0c63060c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.019409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d6a27-2e54-41fc-95f0-67cf0c63060c admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.020938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d6a27-2e54-41fc-95f0-67cf0c63060c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.023898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d6a27-2e54-41fc-95f0-67cf0c63060c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.077554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92d191-71a9-4a30-8e4e-ff9f4c6d5658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.078775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92d191-71a9-4a30-8e4e-ff9f4c6d5658 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.079124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92d191-71a9-4a30-8e4e-ff9f4c6d5658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.080028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92d191-71a9-4a30-8e4e-ff9f4c6d5658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.080923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92d191-71a9-4a30-8e4e-ff9f4c6d5658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.083435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92d191-71a9-4a30-8e4e-ff9f4c6d5658 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.098947 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 989/1958] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:40.105088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92d191-71a9-4a30-8e4e-ff9f4c6d5658 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.116487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92d191-71a9-4a30-8e4e-ff9f4c6d5658 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.124605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdae8e-aca9-45f9-88bf-02937be28194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.125592 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdae8e-aca9-45f9-88bf-02937be28194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.126043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdae8e-aca9-45f9-88bf-02937be28194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.126365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdae8e-aca9-45f9-88bf-02937be28194 admin admin] PATH_INFO: `/v3/projects/ebafb652357e4a649e5a7974543b1314/users/f7eb7f590e0e4981b41f5896b5dcd9f6/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.162043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 970/1959] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:39 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:40.163259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d6a27-2e54-41fc-95f0-67cf0c63060c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.168740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdae8e-aca9-45f9-88bf-02937be28194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebafb652357e4a649e5a7974543b1314, user_id=f7eb7f590e0e4981b41f5896b5dcd9f6, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.172028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdae8e-aca9-45f9-88bf-02937be28194 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.185041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d6a27-2e54-41fc-95f0-67cf0c63060c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.189967 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cca46-be19-4737-9aeb-15dfe9b25d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.190616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cca46-be19-4737-9aeb-15dfe9b25d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.190921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cca46-be19-4737-9aeb-15dfe9b25d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.191195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cca46-be19-4737-9aeb-15dfe9b25d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.191849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cca46-be19-4737-9aeb-15dfe9b25d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.193448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cca46-be19-4737-9aeb-15dfe9b25d96 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.205876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 971/1960] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:40.210339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cca46-be19-4737-9aeb-15dfe9b25d96 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.221583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cca46-be19-4737-9aeb-15dfe9b25d96 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.226601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f237f-b177-4b70-8e71-628c581f8dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.227282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f237f-b177-4b70-8e71-628c581f8dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.227561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f237f-b177-4b70-8e71-628c581f8dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.227832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f237f-b177-4b70-8e71-628c581f8dc4 admin admin] PATH_INFO: `/v3/projects/7fb819aaed444a1f94eca11dfc6ec971/users/70657eac70964dbfb631754e2fa86d60/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.244077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f237f-b177-4b70-8e71-628c581f8dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb819aaed444a1f94eca11dfc6ec971, user_id=70657eac70964dbfb631754e2fa86d60, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.247222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f237f-b177-4b70-8e71-628c581f8dc4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.310870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 990/1961] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:40 2022] PUT /identity/v3/projects/ebafb652357e4a649e5a7974543b1314/users/f7eb7f590e0e4981b41f5896b5dcd9f6/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:40.321092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64008385-b1d1-4a8a-b1fc-a06b246c2c05 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.321374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64008385-b1d1-4a8a-b1fc-a06b246c2c05 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.321682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64008385-b1d1-4a8a-b1fc-a06b246c2c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.339721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 972/1962] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:40 2022] PUT /identity/v3/projects/7fb819aaed444a1f94eca11dfc6ec971/users/70657eac70964dbfb631754e2fa86d60/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:40.345423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f237f-b177-4b70-8e71-628c581f8dc4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.351424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-64008385-b1d1-4a8a-b1fc-a06b246c2c05 None None] MFA Rules not processed for user `f7eb7f590e0e4981b41f5896b5dcd9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:40.352702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-64008385-b1d1-4a8a-b1fc-a06b246c2c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:40.441241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 991/1963] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:40.446426 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64008385-b1d1-4a8a-b1fc-a06b246c2c05 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.446673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f237f-b177-4b70-8e71-628c581f8dc4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.451697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8417ba-4e1a-460b-b6a8-3c5a531ec400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.452346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8417ba-4e1a-460b-b6a8-3c5a531ec400 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.452631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8417ba-4e1a-460b-b6a8-3c5a531ec400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.452902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8417ba-4e1a-460b-b6a8-3c5a531ec400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.453600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8417ba-4e1a-460b-b6a8-3c5a531ec400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.455272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8417ba-4e1a-460b-b6a8-3c5a531ec400 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.458663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64008385-b1d1-4a8a-b1fc-a06b246c2c05 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.469140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6cebe-07a3-469e-8108-f93828e44bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.469140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6cebe-07a3-469e-8108-f93828e44bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.469140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6cebe-07a3-469e-8108-f93828e44bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.469140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6cebe-07a3-469e-8108-f93828e44bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.469449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6cebe-07a3-469e-8108-f93828e44bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.469449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6cebe-07a3-469e-8108-f93828e44bcf admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.469640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 973/1964] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:03:40.472307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8417ba-4e1a-460b-b6a8-3c5a531ec400 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.485814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8417ba-4e1a-460b-b6a8-3c5a531ec400 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.492157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7e685-5fb8-4779-a7f5-5c61f573adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.493012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7e685-5fb8-4779-a7f5-5c61f573adc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.493617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7e685-5fb8-4779-a7f5-5c61f573adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.493845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7e685-5fb8-4779-a7f5-5c61f573adc0 admin admin] PATH_INFO: `/v3/projects/7fb819aaed444a1f94eca11dfc6ec971/users/70657eac70964dbfb631754e2fa86d60/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.497163 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7e685-5fb8-4779-a7f5-5c61f573adc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb819aaed444a1f94eca11dfc6ec971, user_id=70657eac70964dbfb631754e2fa86d60, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.500128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7e685-5fb8-4779-a7f5-5c61f573adc0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.521436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 974/1965] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:40 2022] PUT /identity/v3/projects/7fb819aaed444a1f94eca11dfc6ec971/users/70657eac70964dbfb631754e2fa86d60/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:40.522956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e242d51-cf9e-40a2-83ab-8bbfcc6db033 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.523239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e242d51-cf9e-40a2-83ab-8bbfcc6db033 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.523509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e242d51-cf9e-40a2-83ab-8bbfcc6db033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.554714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2e242d51-cf9e-40a2-83ab-8bbfcc6db033 None None] MFA Rules not processed for user `70657eac70964dbfb631754e2fa86d60`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:40.555953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2e242d51-cf9e-40a2-83ab-8bbfcc6db033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:40.635845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 975/1966] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:40.655571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 992/1967] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:40 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:40.656243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e242d51-cf9e-40a2-83ab-8bbfcc6db033 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.692481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6cebe-07a3-469e-8108-f93828e44bcf admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.694251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-56a6cebe-07a3-469e-8108-f93828e44bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:40.731900 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e242d51-cf9e-40a2-83ab-8bbfcc6db033 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.754337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6cebe-07a3-469e-8108-f93828e44bcf admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.758138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642e14b-3b41-4fb5-ab68-a65e0a390756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.758802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642e14b-3b41-4fb5-ab68-a65e0a390756 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.759083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642e14b-3b41-4fb5-ab68-a65e0a390756 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.759357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642e14b-3b41-4fb5-ab68-a65e0a390756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.811801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c3c6c-1438-48cd-b867-8fe45e1b7134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.812424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c3c6c-1438-48cd-b867-8fe45e1b7134 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.812703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c3c6c-1438-48cd-b867-8fe45e1b7134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.812977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c3c6c-1438-48cd-b867-8fe45e1b7134 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.813642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c3c6c-1438-48cd-b867-8fe45e1b7134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.815647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c3c6c-1438-48cd-b867-8fe45e1b7134 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.831848 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642e14b-3b41-4fb5-ab68-a65e0a390756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.833240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642e14b-3b41-4fb5-ab68-a65e0a390756 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.843929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 993/1968] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:40.918310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 976/1969] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:40 2022] POST /identity/v3/users => generated 299 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:40.922191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642e14b-3b41-4fb5-ab68-a65e0a390756 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.935930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642e14b-3b41-4fb5-ab68-a65e0a390756 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.941002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680674-6687-4a9a-96c0-25b018b4d8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.941694 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680674-6687-4a9a-96c0-25b018b4d8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.941973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680674-6687-4a9a-96c0-25b018b4d8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.942243 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680674-6687-4a9a-96c0-25b018b4d8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:40.942985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c680674-6687-4a9a-96c0-25b018b4d8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:40.944707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c680674-6687-4a9a-96c0-25b018b4d8b1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:40.961822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 994/1970] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:40.962630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c3c6c-1438-48cd-b867-8fe45e1b7134 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:40.976568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c3c6c-1438-48cd-b867-8fe45e1b7134 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:40.986911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16998c-4587-4908-aaac-f1d20712d79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:40.986911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16998c-4587-4908-aaac-f1d20712d79f admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:40.986911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16998c-4587-4908-aaac-f1d20712d79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:40.986911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16998c-4587-4908-aaac-f1d20712d79f admin admin] PATH_INFO: `/v3/projects/30213edde9534f228dfb5e1a4ffd542f/users/3a40cdf35fbd47888a3c8ccd7c49fe95/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:41.004738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16998c-4587-4908-aaac-f1d20712d79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30213edde9534f228dfb5e1a4ffd542f, user_id=3a40cdf35fbd47888a3c8ccd7c49fe95, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:41.007521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16998c-4587-4908-aaac-f1d20712d79f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:41.055529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:41.105081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 977/1971] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:40 2022] PUT /identity/v3/projects/30213edde9534f228dfb5e1a4ffd542f/users/3a40cdf35fbd47888a3c8ccd7c49fe95/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:41.108980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680674-6687-4a9a-96c0-25b018b4d8b1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:41.121889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680674-6687-4a9a-96c0-25b018b4d8b1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:41.238901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483b289-531e-4a18-8f69-a7c3e27694da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:41.239517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483b289-531e-4a18-8f69-a7c3e27694da admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:41.239796 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483b289-531e-4a18-8f69-a7c3e27694da admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:41.240106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483b289-531e-4a18-8f69-a7c3e27694da admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:41.241015 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483b289-531e-4a18-8f69-a7c3e27694da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:41.242837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483b289-531e-4a18-8f69-a7c3e27694da admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:41.256181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 995/1972] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:41.261033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16998c-4587-4908-aaac-f1d20712d79f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:41.272860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16998c-4587-4908-aaac-f1d20712d79f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:41.282725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8e77f-92a9-4057-b48e-d2e174b2cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:41.283397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e77f-92a9-4057-b48e-d2e174b2cf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:41.283678 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e77f-92a9-4057-b48e-d2e174b2cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:41.283945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e77f-92a9-4057-b48e-d2e174b2cf8d admin admin] PATH_INFO: `/v3/projects/30213edde9534f228dfb5e1a4ffd542f/users/3a40cdf35fbd47888a3c8ccd7c49fe95/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:41.287888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8e77f-92a9-4057-b48e-d2e174b2cf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=30213edde9534f228dfb5e1a4ffd542f, user_id=3a40cdf35fbd47888a3c8ccd7c49fe95, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:41.289720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8e77f-92a9-4057-b48e-d2e174b2cf8d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:41.329177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 978/1973] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:41 2022] PUT /identity/v3/projects/30213edde9534f228dfb5e1a4ffd542f/users/3a40cdf35fbd47888a3c8ccd7c49fe95/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:41.331185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557fb6c-45c0-4701-837f-41ba0eb36844 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:41.331801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557fb6c-45c0-4701-837f-41ba0eb36844 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:41.339909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557fb6c-45c0-4701-837f-41ba0eb36844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:41.378749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c557fb6c-45c0-4701-837f-41ba0eb36844 None None] MFA Rules not processed for user `3a40cdf35fbd47888a3c8ccd7c49fe95`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:41.378749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c557fb6c-45c0-4701-837f-41ba0eb36844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:41.472275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 996/1974] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:41.485268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8e77f-92a9-4057-b48e-d2e174b2cf8d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:41.487312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-99d8e77f-92a9-4057-b48e-d2e174b2cf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:41.547568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8e77f-92a9-4057-b48e-d2e174b2cf8d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:41.551489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb247-eb69-4705-9234-35d6e2cace10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:41.555007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb247-eb69-4705-9234-35d6e2cace10 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:41.555007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb247-eb69-4705-9234-35d6e2cace10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:41.555007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb247-eb69-4705-9234-35d6e2cace10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:41.568026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffb247-eb69-4705-9234-35d6e2cace10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:41.568725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffb247-eb69-4705-9234-35d6e2cace10 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:41.577886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557fb6c-45c0-4701-837f-41ba0eb36844 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:41.580616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 979/1975] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:41.611626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb247-eb69-4705-9234-35d6e2cace10 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:41.663769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557fb6c-45c0-4701-837f-41ba0eb36844 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:41.669739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:41.670497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:41.670784 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:41.671183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] PATH_INFO: `/v3/users/c8b7b0ccc5e64012bc390cc136127a7b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:41.672593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b7b0ccc5e64012bc390cc136127a7b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:41.674724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:41.678063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb247-eb69-4705-9234-35d6e2cace10 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:41.683629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:41.686581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:41.686581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:41.686581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] PATH_INFO: `/v3/users/f7eb7f590e0e4981b41f5896b5dcd9f6` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:41.686581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7eb7f590e0e4981b41f5896b5dcd9f6)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:41.688136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:41.717195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:41.939399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b7b0ccc5e64012bc390cc136127a7b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:41.940018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b7b0ccc5e64012bc390cc136127a7b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:41.940627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b7b0ccc5e64012bc390cc136127a7b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:41.965082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7eb7f590e0e4981b41f5896b5dcd9f6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:41.972220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7eb7f590e0e4981b41f5896b5dcd9f6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:41.972915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7eb7f590e0e4981b41f5896b5dcd9f6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:41.973569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7eb7f590e0e4981b41f5896b5dcd9f6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:42.008260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b7b0ccc5e64012bc390cc136127a7b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:42.021627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-299fcb1c-7fb7-456c-9a06-80f42c0517eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b7b0ccc5e64012bc390cc136127a7b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:42.034609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 997/1976] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:41 2022] DELETE /identity/v3/users/c8b7b0ccc5e64012bc390cc136127a7b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:42.039185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7ae8-0f41-4503-a629-d2b737b35e96 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:42.039471 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7ae8-0f41-4503-a629-d2b737b35e96 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:42.039742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7ae8-0f41-4503-a629-d2b737b35e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:42.058402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-605a7ae8-0f41-4503-a629-d2b737b35e96 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:42.059614 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-605a7ae8-0f41-4503-a629-d2b737b35e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:42.105798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e9883ec0-bc68-454e-8ca1-df1cadfef90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7eb7f590e0e4981b41f5896b5dcd9f6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:42.130834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 980/1977] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:41 2022] DELETE /identity/v3/users/f7eb7f590e0e4981b41f5896b5dcd9f6 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:42.135877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4913-b734-4e32-a250-eb08d5bdbc06 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:42.136434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4913-b734-4e32-a250-eb08d5bdbc06 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:42.136995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4913-b734-4e32-a250-eb08d5bdbc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:42.140971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 998/1978] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:42.150956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a7ae8-0f41-4503-a629-d2b737b35e96 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:42.152359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-605a7ae8-0f41-4503-a629-d2b737b35e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:42.158145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-144a4913-b734-4e32-a250-eb08d5bdbc06 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:42.161160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-144a4913-b734-4e32-a250-eb08d5bdbc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:42.225054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a7ae8-0f41-4503-a629-d2b737b35e96 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:42.241780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 981/1979] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:42.252969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4913-b734-4e32-a250-eb08d5bdbc06 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:42.287559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb5f97-80de-475d-a609-7cad28cdadac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:42.288317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb5f97-80de-475d-a609-7cad28cdadac service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:42.288618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb5f97-80de-475d-a609-7cad28cdadac service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:42.289024 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb5f97-80de-475d-a609-7cad28cdadac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:42.299789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb5f97-80de-475d-a609-7cad28cdadac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:42.301301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb5f97-80de-475d-a609-7cad28cdadac service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:42.311930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 999/1980] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:42.314359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4913-b734-4e32-a250-eb08d5bdbc06 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:42.319926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9b5ee-2dd3-4338-aab4-4454f43e4a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:42.320570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9b5ee-2dd3-4338-aab4-4454f43e4a76 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:42.320868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9b5ee-2dd3-4338-aab4-4454f43e4a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:42.321139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9b5ee-2dd3-4338-aab4-4454f43e4a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:42.333005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9b5ee-2dd3-4338-aab4-4454f43e4a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:42.334476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9b5ee-2dd3-4338-aab4-4454f43e4a76 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:42.344851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 982/1981] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:42.975264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:43.155416 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb5f97-80de-475d-a609-7cad28cdadac service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:43.157120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bedb5f97-80de-475d-a609-7cad28cdadac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:43.159435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9b5ee-2dd3-4338-aab4-4454f43e4a76 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:43.162343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-89b9b5ee-2dd3-4338-aab4-4454f43e4a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:43.187791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb5f97-80de-475d-a609-7cad28cdadac service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:43.190528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9b5ee-2dd3-4338-aab4-4454f43e4a76 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:43.200843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:43.202473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:43.204865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:43.204865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:43.204865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] PATH_INFO: `/v3/projects/bfd189fdae7e468d84db26864c28f9e7` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:43.205118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:43.205118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:43.205395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] PATH_INFO: `/v3/projects/ebafb652357e4a649e5a7974543b1314` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:43.206612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd189fdae7e468d84db26864c28f9e7)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:43.207658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebafb652357e4a649e5a7974543b1314)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:43.209594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:43.214106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:43.383549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd189fdae7e468d84db26864c28f9e7', 'request_id': 'req-1428cca2-1420-4a6d-91f6-8aad7ae7def7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.392039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebafb652357e4a649e5a7974543b1314', 'request_id': 'req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.401256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebafb652357e4a649e5a7974543b1314', 'request_id': 'req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.402090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd189fdae7e468d84db26864c28f9e7', 'request_id': 'req-1428cca2-1420-4a6d-91f6-8aad7ae7def7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.410655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebafb652357e4a649e5a7974543b1314', 'request_id': 'req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.422350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd189fdae7e468d84db26864c28f9e7', 'request_id': 'req-1428cca2-1420-4a6d-91f6-8aad7ae7def7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.454213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:43.516090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] The token cache is being invalidate because project ebafb652357e4a649e5a7974543b1314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:43.516276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.516959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.519114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1000/1982] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:43 2022] DELETE /identity/v3/projects/ebafb652357e4a649e5a7974543b1314 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:43.523646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:43.524765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:43.602138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cc734-46a9-4a9b-9ce4-f76e2e1d1868 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:43.604467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] The token cache is being invalidate because project bfd189fdae7e468d84db26864c28f9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:43.605184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.606883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.607961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:43.608611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:43.609049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:43.612313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] PATH_INFO: `/v3/users/3a40cdf35fbd47888a3c8ccd7c49fe95` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:43.613352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 983/1983] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:43 2022] DELETE /identity/v3/projects/bfd189fdae7e468d84db26864c28f9e7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:43.613739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a40cdf35fbd47888a3c8ccd7c49fe95)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:43.614580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:43.616323 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:43.616634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:43.710555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428cca2-1420-4a6d-91f6-8aad7ae7def7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:43.726208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:43.727038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:43.727957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:43.728286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] PATH_INFO: `/v3/users/70657eac70964dbfb631754e2fa86d60` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:43.730648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70657eac70964dbfb631754e2fa86d60)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:43.733218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:43.830005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a40cdf35fbd47888a3c8ccd7c49fe95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.830976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a40cdf35fbd47888a3c8ccd7c49fe95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.831372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a40cdf35fbd47888a3c8ccd7c49fe95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.900703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a40cdf35fbd47888a3c8ccd7c49fe95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.945528 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a40cdf35fbd47888a3c8ccd7c49fe95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.962406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70657eac70964dbfb631754e2fa86d60'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.993007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1001/1984] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:43 2022] DELETE /identity/v3/users/3a40cdf35fbd47888a3c8ccd7c49fe95 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:43.998021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70657eac70964dbfb631754e2fa86d60'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:43.998960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70657eac70964dbfb631754e2fa86d60'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:44.000591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70657eac70964dbfb631754e2fa86d60'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:44.094136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70657eac70964dbfb631754e2fa86d60'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:44.118811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 984/1985] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:43 2022] DELETE /identity/v3/users/70657eac70964dbfb631754e2fa86d60 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:44.174940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:44.900278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:44.906801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:44.908484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:44.909667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:45.101526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f3f0b-7ba2-4c54-8c48-3ac1b662ee37 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.120732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20e4b-997b-4309-bf42-46e0cc0e9c19 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.126563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.127460 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.127929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.128740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] PATH_INFO: `/v3/projects/30213edde9534f228dfb5e1a4ffd542f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.130005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30213edde9534f228dfb5e1a4ffd542f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.132596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.165331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:45.185984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.188068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.188068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.188068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] PATH_INFO: `/v3/projects/7fb819aaed444a1f94eca11dfc6ec971` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.188318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb819aaed444a1f94eca11dfc6ec971)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.190252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.253807 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30213edde9534f228dfb5e1a4ffd542f', 'request_id': 'req-b0411c1f-f326-4ae0-9fac-42922e48a247'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.259121 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30213edde9534f228dfb5e1a4ffd542f', 'request_id': 'req-b0411c1f-f326-4ae0-9fac-42922e48a247'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.264774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:45.266040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30213edde9534f228dfb5e1a4ffd542f', 'request_id': 'req-b0411c1f-f326-4ae0-9fac-42922e48a247'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.324082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb819aaed444a1f94eca11dfc6ec971', 'request_id': 'req-99ad543b-bcb7-4b30-a10b-c82439777cfd'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.330147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb819aaed444a1f94eca11dfc6ec971', 'request_id': 'req-99ad543b-bcb7-4b30-a10b-c82439777cfd'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.336709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb819aaed444a1f94eca11dfc6ec971', 'request_id': 'req-99ad543b-bcb7-4b30-a10b-c82439777cfd'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.347632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] The token cache is being invalidate because project 30213edde9534f228dfb5e1a4ffd542f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:45.347632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.348318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b0411c1f-f326-4ae0-9fac-42922e48a247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.350081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 985/1986] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:44 2022] DELETE /identity/v3/projects/30213edde9534f228dfb5e1a4ffd542f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:45.355099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb146c-4db3-453a-8f0d-f2d750e78f22 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.355845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb146c-4db3-453a-8f0d-f2d750e78f22 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.356352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb146c-4db3-453a-8f0d-f2d750e78f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.380316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-70bb146c-4db3-453a-8f0d-f2d750e78f22 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:45.381665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-70bb146c-4db3-453a-8f0d-f2d750e78f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:45.438274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] The token cache is being invalidate because project 7fb819aaed444a1f94eca11dfc6ec971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:45.439409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.439517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ad543b-bcb7-4b30-a10b-c82439777cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:45.440962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1002/1987] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:44 2022] DELETE /identity/v3/projects/7fb819aaed444a1f94eca11dfc6ec971 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:45.445569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac3a94-70c2-4808-98d1-5c6333f79482 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.445927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac3a94-70c2-4808-98d1-5c6333f79482 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.446260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac3a94-70c2-4808-98d1-5c6333f79482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.453262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 986/1988] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:45.461150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e8e50-2cdf-4dec-aa8f-70fa204dcb87 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.461434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e8e50-2cdf-4dec-aa8f-70fa204dcb87 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.461726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e8e50-2cdf-4dec-aa8f-70fa204dcb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.478941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-64ac3a94-70c2-4808-98d1-5c6333f79482 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:45.482385 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-64ac3a94-70c2-4808-98d1-5c6333f79482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:45.483574 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dd9e8e50-2cdf-4dec-aa8f-70fa204dcb87 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:45.484969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dd9e8e50-2cdf-4dec-aa8f-70fa204dcb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:45.498909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 987/1989] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:45.498909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e8e50-2cdf-4dec-aa8f-70fa204dcb87 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.505070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1003/1990] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:45.511527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334244f2-72c4-45d2-aba4-683cd4e890d5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.511803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334244f2-72c4-45d2-aba4-683cd4e890d5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.512069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334244f2-72c4-45d2-aba4-683cd4e890d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.517268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e8e50-2cdf-4dec-aa8f-70fa204dcb87 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.529325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1e73c-4391-4128-90f9-0fad16acbbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.530435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1e73c-4391-4128-90f9-0fad16acbbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.530722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1e73c-4391-4128-90f9-0fad16acbbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.531064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1e73c-4391-4128-90f9-0fad16acbbb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.531878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1e73c-4391-4128-90f9-0fad16acbbb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:45.531993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-334244f2-72c4-45d2-aba4-683cd4e890d5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:45.532186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1e73c-4391-4128-90f9-0fad16acbbb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.533155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-334244f2-72c4-45d2-aba4-683cd4e890d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:45.534956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1e73c-4391-4128-90f9-0fad16acbbb8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.547113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1004/1991] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:45.548071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334244f2-72c4-45d2-aba4-683cd4e890d5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.553312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 988/1992] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:45.560667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334244f2-72c4-45d2-aba4-683cd4e890d5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.568439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1e73c-4391-4128-90f9-0fad16acbbb8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.568582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037365-e546-4eec-8403-9991500db490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.568582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037365-e546-4eec-8403-9991500db490 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.568851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037365-e546-4eec-8403-9991500db490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.569034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037365-e546-4eec-8403-9991500db490 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.569888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037365-e546-4eec-8403-9991500db490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:03:45.570029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037365-e546-4eec-8403-9991500db490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.581331 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037365-e546-4eec-8403-9991500db490 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.585040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1e73c-4391-4128-90f9-0fad16acbbb8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.586544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1005/1993] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:03:45.591259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037365-e546-4eec-8403-9991500db490 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.596833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef153c8-700a-4e22-ac8c-3579e6b9fb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.596833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef153c8-700a-4e22-ac8c-3579e6b9fb42 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.596833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef153c8-700a-4e22-ac8c-3579e6b9fb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.596833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef153c8-700a-4e22-ac8c-3579e6b9fb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.599261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef153c8-700a-4e22-ac8c-3579e6b9fb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.600189 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef153c8-700a-4e22-ac8c-3579e6b9fb42 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.601879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037365-e546-4eec-8403-9991500db490 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.607191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505ac3e-e9cc-48f0-ac7e-3fb4b5318eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.607795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ac3e-e9cc-48f0-ac7e-3fb4b5318eda admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.608069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ac3e-e9cc-48f0-ac7e-3fb4b5318eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.608368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505ac3e-e9cc-48f0-ac7e-3fb4b5318eda admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.608955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505ac3e-e9cc-48f0-ac7e-3fb4b5318eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.610925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505ac3e-e9cc-48f0-ac7e-3fb4b5318eda admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.722318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 989/1994] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:45 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:45.725493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef153c8-700a-4e22-ac8c-3579e6b9fb42 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.731235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1006/1995] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:45 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:45.735159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505ac3e-e9cc-48f0-ac7e-3fb4b5318eda admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.786564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef153c8-700a-4e22-ac8c-3579e6b9fb42 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.796869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505ac3e-e9cc-48f0-ac7e-3fb4b5318eda admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.802208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29edef-c9d4-4305-bfd1-2b38ace8be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.802870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29edef-c9d4-4305-bfd1-2b38ace8be33 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.803151 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29edef-c9d4-4305-bfd1-2b38ace8be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.803422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29edef-c9d4-4305-bfd1-2b38ace8be33 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.804095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29edef-c9d4-4305-bfd1-2b38ace8be33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.806114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29edef-c9d4-4305-bfd1-2b38ace8be33 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.853106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2b173-261c-47d1-81d1-da0ec3d888f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.853766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2b173-261c-47d1-81d1-da0ec3d888f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.854042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2b173-261c-47d1-81d1-da0ec3d888f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.854313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2b173-261c-47d1-81d1-da0ec3d888f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.854927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2b173-261c-47d1-81d1-da0ec3d888f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.856833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2b173-261c-47d1-81d1-da0ec3d888f7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.889455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1007/1996] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:45 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:45.893208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29edef-c9d4-4305-bfd1-2b38ace8be33 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.903020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29edef-c9d4-4305-bfd1-2b38ace8be33 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.907791 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a4f52-5e0b-4a38-bf1e-07cf183198be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.908395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4f52-5e0b-4a38-bf1e-07cf183198be admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.908677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4f52-5e0b-4a38-bf1e-07cf183198be admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.908950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4f52-5e0b-4a38-bf1e-07cf183198be admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.909665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a4f52-5e0b-4a38-bf1e-07cf183198be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.911248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a4f52-5e0b-4a38-bf1e-07cf183198be admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.921290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1008/1997] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:03:45.924731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a4f52-5e0b-4a38-bf1e-07cf183198be admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.934793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a4f52-5e0b-4a38-bf1e-07cf183198be admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.939444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17064f-d97f-4689-b68e-48e287c901b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.940011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17064f-d97f-4689-b68e-48e287c901b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.940297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17064f-d97f-4689-b68e-48e287c901b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.940570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17064f-d97f-4689-b68e-48e287c901b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.941185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17064f-d97f-4689-b68e-48e287c901b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.942903 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17064f-d97f-4689-b68e-48e287c901b2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.945796 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 990/1998] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:45 2022] POST /identity/v3/users => generated 305 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:45.950426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2b173-261c-47d1-81d1-da0ec3d888f7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.954689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1009/1999] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:03:45.958627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17064f-d97f-4689-b68e-48e287c901b2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.960558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2b173-261c-47d1-81d1-da0ec3d888f7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.971657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1fdfa-c5da-4fae-8c8b-0d5105b36bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.972273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1fdfa-c5da-4fae-8c8b-0d5105b36bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.972551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1fdfa-c5da-4fae-8c8b-0d5105b36bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.972822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1fdfa-c5da-4fae-8c8b-0d5105b36bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.973501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1fdfa-c5da-4fae-8c8b-0d5105b36bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.973725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17064f-d97f-4689-b68e-48e287c901b2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:45.975105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1fdfa-c5da-4fae-8c8b-0d5105b36bcc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:45.979330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e81d3-75a7-45ea-91ab-e091d0845292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:45.979995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e81d3-75a7-45ea-91ab-e091d0845292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:45.980268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e81d3-75a7-45ea-91ab-e091d0845292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:45.980543 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e81d3-75a7-45ea-91ab-e091d0845292 admin admin] PATH_INFO: `/v3/projects/e83db33f39c24b638403721230239959/users/fa26df86a0ef479f879972f3b9f12fa3/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:45.989397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 991/2000] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:03:45.990540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1fdfa-c5da-4fae-8c8b-0d5105b36bcc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:45.996368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e81d3-75a7-45ea-91ab-e091d0845292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83db33f39c24b638403721230239959, user_id=fa26df86a0ef479f879972f3b9f12fa3, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:45.999056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e81d3-75a7-45ea-91ab-e091d0845292 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:46.001651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1fdfa-c5da-4fae-8c8b-0d5105b36bcc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:46.006646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65599fd8-7296-4bd4-a0a0-b8ac0fb1e33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:46.007253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65599fd8-7296-4bd4-a0a0-b8ac0fb1e33d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.007533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65599fd8-7296-4bd4-a0a0-b8ac0fb1e33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.007804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65599fd8-7296-4bd4-a0a0-b8ac0fb1e33d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.008501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65599fd8-7296-4bd4-a0a0-b8ac0fb1e33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:46.010914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65599fd8-7296-4bd4-a0a0-b8ac0fb1e33d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:46.021683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 992/2001] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:46.026013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65599fd8-7296-4bd4-a0a0-b8ac0fb1e33d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:46.035505 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65599fd8-7296-4bd4-a0a0-b8ac0fb1e33d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:46.040026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b5d3d-695c-4caf-a8bc-4784dbb1df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:46.040699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b5d3d-695c-4caf-a8bc-4784dbb1df47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.041024 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b5d3d-695c-4caf-a8bc-4784dbb1df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.041254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b5d3d-695c-4caf-a8bc-4784dbb1df47 admin admin] PATH_INFO: `/v3/projects/faed058095b64cc48761e6488d8b602d/users/adf4f34615cb443881dcebf2324fa210/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.055134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b5d3d-695c-4caf-a8bc-4784dbb1df47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faed058095b64cc48761e6488d8b602d, user_id=adf4f34615cb443881dcebf2324fa210, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:46.058586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b5d3d-695c-4caf-a8bc-4784dbb1df47 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:46.088379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1010/2002] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:45 2022] PUT /identity/v3/projects/e83db33f39c24b638403721230239959/users/fa26df86a0ef479f879972f3b9f12fa3/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:46.093318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f15e75-3d52-4c21-bea2-c01ae821b55b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.093634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f15e75-3d52-4c21-bea2-c01ae821b55b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.093913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f15e75-3d52-4c21-bea2-c01ae821b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.112306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-93f15e75-3d52-4c21-bea2-c01ae821b55b None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:46.113693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-93f15e75-3d52-4c21-bea2-c01ae821b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:46.180765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1011/2003] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:46.188231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 993/2004] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:46 2022] PUT /identity/v3/projects/faed058095b64cc48761e6488d8b602d/users/adf4f34615cb443881dcebf2324fa210/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:03:46.192265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f15e75-3d52-4c21-bea2-c01ae821b55b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:46.203389 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-93f15e75-3d52-4c21-bea2-c01ae821b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:46.205406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2c8b7-81aa-4738-8428-aa1f720bcbc4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.205903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2c8b7-81aa-4738-8428-aa1f720bcbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.206180 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2c8b7-81aa-4738-8428-aa1f720bcbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.236856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7de2c8b7-81aa-4738-8428-aa1f720bcbc4 None None] MFA Rules not processed for user `adf4f34615cb443881dcebf2324fa210`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:46.238117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7de2c8b7-81aa-4738-8428-aa1f720bcbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:46.257831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f15e75-3d52-4c21-bea2-c01ae821b55b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:46.289274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:46.310064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd19d6-1891-4c9e-827c-c9aa3da87763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:46.310919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd19d6-1891-4c9e-827c-c9aa3da87763 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.311269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd19d6-1891-4c9e-827c-c9aa3da87763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.311607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd19d6-1891-4c9e-827c-c9aa3da87763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.323859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 994/2005] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:46.327907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2c8b7-81aa-4738-8428-aa1f720bcbc4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:46.347192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:46.380852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd19d6-1891-4c9e-827c-c9aa3da87763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:46.382420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd19d6-1891-4c9e-827c-c9aa3da87763 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:46.392142 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1012/2006] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:46.397872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2c8b7-81aa-4738-8428-aa1f720bcbc4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:46.402463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d9e2a-b524-4596-9aae-754abf9153d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:46.403077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d9e2a-b524-4596-9aae-754abf9153d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.403356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d9e2a-b524-4596-9aae-754abf9153d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.403625 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d9e2a-b524-4596-9aae-754abf9153d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.404261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d9e2a-b524-4596-9aae-754abf9153d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:46.406202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d9e2a-b524-4596-9aae-754abf9153d0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:46.519175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 995/2007] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:46 2022] POST /identity/v3/projects => generated 407 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:03:46.523201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd19d6-1891-4c9e-827c-c9aa3da87763 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:46.533936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd19d6-1891-4c9e-827c-c9aa3da87763 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:46.604758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01c91c-dab1-4497-a8fa-6db03af3a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:46.606041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01c91c-dab1-4497-a8fa-6db03af3a715 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.606321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01c91c-dab1-4497-a8fa-6db03af3a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.606594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01c91c-dab1-4497-a8fa-6db03af3a715 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.607598 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01c91c-dab1-4497-a8fa-6db03af3a715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:46.609680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01c91c-dab1-4497-a8fa-6db03af3a715 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:46.723886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1013/2008] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:46 2022] POST /identity/v3/users => generated 310 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:46.728063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d9e2a-b524-4596-9aae-754abf9153d0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:46.741734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d9e2a-b524-4596-9aae-754abf9153d0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:46.747220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9da62-f832-4af9-a722-19fd92623222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:46.747870 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9da62-f832-4af9-a722-19fd92623222 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.748167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9da62-f832-4af9-a722-19fd92623222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.748633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9da62-f832-4af9-a722-19fd92623222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.749291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9da62-f832-4af9-a722-19fd92623222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:46.773739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9da62-f832-4af9-a722-19fd92623222 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:46.788592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 996/2009] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:46.794230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01c91c-dab1-4497-a8fa-6db03af3a715 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:46.804786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01c91c-dab1-4497-a8fa-6db03af3a715 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:46.810190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100fda4-386b-4795-8c7c-4c4d11b14344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:46.810852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100fda4-386b-4795-8c7c-4c4d11b14344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.811130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100fda4-386b-4795-8c7c-4c4d11b14344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.811404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100fda4-386b-4795-8c7c-4c4d11b14344 admin admin] PATH_INFO: `/v3/projects/96085f2af9c54c44a2263351b713cad4/users/3430fc0169274632a03047b792a4e2a5/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.829205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100fda4-386b-4795-8c7c-4c4d11b14344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96085f2af9c54c44a2263351b713cad4, user_id=3430fc0169274632a03047b792a4e2a5, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:46.831882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100fda4-386b-4795-8c7c-4c4d11b14344 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:46.865952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:46.906935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:46.908722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9da62-f832-4af9-a722-19fd92623222 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:46.908890 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1014/2010] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:46 2022] PUT /identity/v3/projects/96085f2af9c54c44a2263351b713cad4/users/3430fc0169274632a03047b792a4e2a5/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:46.919932 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9da62-f832-4af9-a722-19fd92623222 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:46.990220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130117e-511a-4215-b597-6b5265dd5434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:46.990915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130117e-511a-4215-b597-6b5265dd5434 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:46.991107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130117e-511a-4215-b597-6b5265dd5434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:46.991375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130117e-511a-4215-b597-6b5265dd5434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:46.992039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130117e-511a-4215-b597-6b5265dd5434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:46.993661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130117e-511a-4215-b597-6b5265dd5434 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:47.004288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 997/2011] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:47.008904 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100fda4-386b-4795-8c7c-4c4d11b14344 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:47.021258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100fda4-386b-4795-8c7c-4c4d11b14344 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:47.027311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ef8d-2316-445a-b3a0-c9091aa9515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:47.028316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ef8d-2316-445a-b3a0-c9091aa9515f admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:47.028597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ef8d-2316-445a-b3a0-c9091aa9515f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:47.028862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ef8d-2316-445a-b3a0-c9091aa9515f admin admin] PATH_INFO: `/v3/projects/96085f2af9c54c44a2263351b713cad4/users/3430fc0169274632a03047b792a4e2a5/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:47.030779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ef8d-2316-445a-b3a0-c9091aa9515f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96085f2af9c54c44a2263351b713cad4, user_id=3430fc0169274632a03047b792a4e2a5, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:47.033610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ef8d-2316-445a-b3a0-c9091aa9515f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:47.046455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1015/2012] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:47 2022] PUT /identity/v3/projects/96085f2af9c54c44a2263351b713cad4/users/3430fc0169274632a03047b792a4e2a5/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:47.059708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb1565-c59f-49cc-925e-9823bc5971d2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:47.060315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb1565-c59f-49cc-925e-9823bc5971d2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:47.060590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb1565-c59f-49cc-925e-9823bc5971d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:47.093020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f2eb1565-c59f-49cc-925e-9823bc5971d2 None None] MFA Rules not processed for user `3430fc0169274632a03047b792a4e2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:47.095562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f2eb1565-c59f-49cc-925e-9823bc5971d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:47.170635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 998/2013] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:47 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:47.182377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ef8d-2316-445a-b3a0-c9091aa9515f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:47.184918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9413ef8d-2316-445a-b3a0-c9091aa9515f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:47.252831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ef8d-2316-445a-b3a0-c9091aa9515f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:47.256976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9e493-c10a-4df0-8ddf-deb26f4f8430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:47.257639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e493-c10a-4df0-8ddf-deb26f4f8430 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:47.257919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e493-c10a-4df0-8ddf-deb26f4f8430 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:47.258189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e493-c10a-4df0-8ddf-deb26f4f8430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:47.268551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9e493-c10a-4df0-8ddf-deb26f4f8430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:47.270032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9e493-c10a-4df0-8ddf-deb26f4f8430 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:47.280979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1016/2014] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:47 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:47.671080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb1565-c59f-49cc-925e-9823bc5971d2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:47.673206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f2eb1565-c59f-49cc-925e-9823bc5971d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:47.692300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb1565-c59f-49cc-925e-9823bc5971d2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:47.697691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2673af-02a2-43dd-a12c-ad808ddfe5a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:47.698532 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2673af-02a2-43dd-a12c-ad808ddfe5a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:47.698898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2673af-02a2-43dd-a12c-ad808ddfe5a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:47.699256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2673af-02a2-43dd-a12c-ad808ddfe5a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:47.766535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:47.787417 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2673af-02a2-43dd-a12c-ad808ddfe5a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:47.790161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2673af-02a2-43dd-a12c-ad808ddfe5a0 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:47.800759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 999/2015] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:47 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:03:48.089260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1535c90-08a5-4bad-96ab-9da28462d1cc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:48.089798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1535c90-08a5-4bad-96ab-9da28462d1cc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:48.090071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1535c90-08a5-4bad-96ab-9da28462d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:48.125879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b1535c90-08a5-4bad-96ab-9da28462d1cc None None] MFA Rules not processed for user `fa26df86a0ef479f879972f3b9f12fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:48.127381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b1535c90-08a5-4bad-96ab-9da28462d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:48.220428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1017/2016] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:48.225061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2673af-02a2-43dd-a12c-ad808ddfe5a0 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:48.267720 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:48.307378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2673af-02a2-43dd-a12c-ad808ddfe5a0 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:48.313019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea06e-b090-4b48-a55f-31a91e956820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:48.313750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea06e-b090-4b48-a55f-31a91e956820 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:48.314128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea06e-b090-4b48-a55f-31a91e956820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:48.314459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea06e-b090-4b48-a55f-31a91e956820 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:48.315290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aea06e-b090-4b48-a55f-31a91e956820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:48.317292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aea06e-b090-4b48-a55f-31a91e956820 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:48.424328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1000/2017] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:03:48 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:48.428595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1535c90-08a5-4bad-96ab-9da28462d1cc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:48.443257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1535c90-08a5-4bad-96ab-9da28462d1cc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:48.546186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:48.578277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae63c9-c9f0-437a-bafd-168edb7d6d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:48.579195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae63c9-c9f0-437a-bafd-168edb7d6d7f admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:48.579697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae63c9-c9f0-437a-bafd-168edb7d6d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:48.580193 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae63c9-c9f0-437a-bafd-168edb7d6d7f admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:48.581406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae63c9-c9f0-437a-bafd-168edb7d6d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:48.593739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae63c9-c9f0-437a-bafd-168edb7d6d7f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:48.686356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1018/2018] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:03:48 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:03:48.692044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea06e-b090-4b48-a55f-31a91e956820 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:48.703628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea06e-b090-4b48-a55f-31a91e956820 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:48.708881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7fa4a-ec37-41bf-a5ed-89ab86b150bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:48.709676 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7fa4a-ec37-41bf-a5ed-89ab86b150bb admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:48.709877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7fa4a-ec37-41bf-a5ed-89ab86b150bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:48.710146 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7fa4a-ec37-41bf-a5ed-89ab86b150bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:48.710788 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7fa4a-ec37-41bf-a5ed-89ab86b150bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:48.712439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7fa4a-ec37-41bf-a5ed-89ab86b150bb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:48.728867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1001/2019] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:48.730074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae63c9-c9f0-437a-bafd-168edb7d6d7f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:48.740748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae63c9-c9f0-437a-bafd-168edb7d6d7f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:48.746394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32965bca-65d8-4b09-bd87-32621ae43c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:48.747205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32965bca-65d8-4b09-bd87-32621ae43c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:48.747492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32965bca-65d8-4b09-bd87-32621ae43c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:48.747770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32965bca-65d8-4b09-bd87-32621ae43c29 admin admin] PATH_INFO: `/v3/projects/0470131df53844d2b84430908f99e300/users/fc94ed06a975437298a6386f8813b1a9/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:48.769742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32965bca-65d8-4b09-bd87-32621ae43c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0470131df53844d2b84430908f99e300, user_id=fc94ed06a975437298a6386f8813b1a9, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:48.772427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32965bca-65d8-4b09-bd87-32621ae43c29 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:48.923156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1019/2020] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:48 2022] PUT /identity/v3/projects/0470131df53844d2b84430908f99e300/users/fc94ed06a975437298a6386f8813b1a9/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:48.928030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7fa4a-ec37-41bf-a5ed-89ab86b150bb admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:48.940358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7fa4a-ec37-41bf-a5ed-89ab86b150bb admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:48.999825 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e3c5d-4984-4341-b340-28867b941e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:49.000428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e3c5d-4984-4341-b340-28867b941e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:49.000735 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e3c5d-4984-4341-b340-28867b941e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:49.001002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e3c5d-4984-4341-b340-28867b941e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:49.001665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e3c5d-4984-4341-b340-28867b941e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:49.003513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e3c5d-4984-4341-b340-28867b941e5c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:49.014093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1002/2021] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:49.018294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32965bca-65d8-4b09-bd87-32621ae43c29 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:49.029123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32965bca-65d8-4b09-bd87-32621ae43c29 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:49.033800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e56ee4-dd71-492a-abeb-126e4160fbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:49.034449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e56ee4-dd71-492a-abeb-126e4160fbf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:49.034728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e56ee4-dd71-492a-abeb-126e4160fbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:49.035087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e56ee4-dd71-492a-abeb-126e4160fbf1 admin admin] PATH_INFO: `/v3/projects/0470131df53844d2b84430908f99e300/users/fc94ed06a975437298a6386f8813b1a9/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:49.037035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e56ee4-dd71-492a-abeb-126e4160fbf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0470131df53844d2b84430908f99e300, user_id=fc94ed06a975437298a6386f8813b1a9, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:49.039733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e56ee4-dd71-492a-abeb-126e4160fbf1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:49.050300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1020/2022] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:03:49 2022] PUT /identity/v3/projects/0470131df53844d2b84430908f99e300/users/fc94ed06a975437298a6386f8813b1a9/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:49.219895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:49.898601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:50.317173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214452-974f-4e4c-a1db-431f9a49cccb None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:50.317509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214452-974f-4e4c-a1db-431f9a49cccb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:50.317938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214452-974f-4e4c-a1db-431f9a49cccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:50.346166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-92214452-974f-4e4c-a1db-431f9a49cccb None None] MFA Rules not processed for user `fc94ed06a975437298a6386f8813b1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:50.347462 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-92214452-974f-4e4c-a1db-431f9a49cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:50.356249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:50.426377 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1003/2023] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:50.437939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771e174-aaf3-4d2f-b86f-cca08c837187 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:50.438225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771e174-aaf3-4d2f-b86f-cca08c837187 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:50.438497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771e174-aaf3-4d2f-b86f-cca08c837187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:50.457244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2771e174-aaf3-4d2f-b86f-cca08c837187 None None] MFA Rules not processed for user `fa26df86a0ef479f879972f3b9f12fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:50.458501 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2771e174-aaf3-4d2f-b86f-cca08c837187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:50.512714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1021/2024] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:50.524070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92214452-974f-4e4c-a1db-431f9a49cccb None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:50.526264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-92214452-974f-4e4c-a1db-431f9a49cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:50.562632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:50.601646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92214452-974f-4e4c-a1db-431f9a49cccb None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:50.608023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3a137-4bf8-4432-8728-f81cd14eed8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:50.608758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3a137-4bf8-4432-8728-f81cd14eed8b service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:50.609117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3a137-4bf8-4432-8728-f81cd14eed8b service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:50.609487 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3a137-4bf8-4432-8728-f81cd14eed8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:50.621458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3a137-4bf8-4432-8728-f81cd14eed8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:50.623704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3a137-4bf8-4432-8728-f81cd14eed8b service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:50.634838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1004/2025] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:51.118126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:52.111242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:52.893979 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:53.054331 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:53.825525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:53.928055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:54.247072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:54.404344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:54.636879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:54.773553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:55.121919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:55.151512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:55.488325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:55.528440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:56.338920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:56.476056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:56.955537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771e174-aaf3-4d2f-b86f-cca08c837187 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.020805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771e174-aaf3-4d2f-b86f-cca08c837187 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.026421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.027178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.027462 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.030404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] PATH_INFO: `/v3/users/adf4f34615cb443881dcebf2324fa210` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.030404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf4f34615cb443881dcebf2324fa210)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.031079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.122798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:57.251369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf4f34615cb443881dcebf2324fa210'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:57.252640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf4f34615cb443881dcebf2324fa210'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:57.253539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf4f34615cb443881dcebf2324fa210'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:57.457096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf4f34615cb443881dcebf2324fa210'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:57.457096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf4f34615cb443881dcebf2324fa210'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:57.457096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1022/2026] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:56 2022] DELETE /identity/v3/users/adf4f34615cb443881dcebf2324fa210 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:57.457684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef6b6-3eb3-422d-8ac8-94c7e69853bf None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.457684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef6b6-3eb3-422d-8ac8-94c7e69853bf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.457684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef6b6-3eb3-422d-8ac8-94c7e69853bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.458284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:57.458377 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-aa4ef6b6-3eb3-422d-8ac8-94c7e69853bf None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:57.458377 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aa4ef6b6-3eb3-422d-8ac8-94c7e69853bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:57.546005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1005/2027] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:57.561375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:57.565264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:57.684571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d439a14-348e-453f-82d1-561404126972 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:57.689110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb73e01-250a-44c5-9091-33c5e472afed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:57.690954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb73e01-250a-44c5-9091-33c5e472afed service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:57.691447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb73e01-250a-44c5-9091-33c5e472afed service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:57.691872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb73e01-250a-44c5-9091-33c5e472afed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:57.704273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb73e01-250a-44c5-9091-33c5e472afed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:57.707304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb73e01-250a-44c5-9091-33c5e472afed service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:57.734585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1023/2028] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:57.968353 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:58.144632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:58.614399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:58.684334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:58.959798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef6b6-3eb3-422d-8ac8-94c7e69853bf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:58.963027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aa4ef6b6-3eb3-422d-8ac8-94c7e69853bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:58.989724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef6b6-3eb3-422d-8ac8-94c7e69853bf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:58.997779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:58.997779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:58.997779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:58.998224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] PATH_INFO: `/v3/projects/faed058095b64cc48761e6488d8b602d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:58.999185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faed058095b64cc48761e6488d8b602d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:59.001173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:59.147009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:59.151930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faed058095b64cc48761e6488d8b602d', 'request_id': 'req-8427713b-86c4-4b1e-b21b-5952027d56d3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.159890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faed058095b64cc48761e6488d8b602d', 'request_id': 'req-8427713b-86c4-4b1e-b21b-5952027d56d3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.170067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faed058095b64cc48761e6488d8b602d', 'request_id': 'req-8427713b-86c4-4b1e-b21b-5952027d56d3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.238536 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] The token cache is being invalidate because project faed058095b64cc48761e6488d8b602d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:03:59.239402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.240150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.242809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1006/2029] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:03:58 2022] DELETE /identity/v3/projects/faed058095b64cc48761e6488d8b602d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:03:59.247183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb73e01-250a-44c5-9091-33c5e472afed service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:59.264699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb73e01-250a-44c5-9091-33c5e472afed service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:59.373236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:59.374037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:59.374488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:59.374760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] PATH_INFO: `/v3/users/3430fc0169274632a03047b792a4e2a5` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:59.375929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3430fc0169274632a03047b792a4e2a5)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:59.378255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:59.535758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:59.648104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3430fc0169274632a03047b792a4e2a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.649172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3430fc0169274632a03047b792a4e2a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.649798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3430fc0169274632a03047b792a4e2a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.717716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3430fc0169274632a03047b792a4e2a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.735001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3430fc0169274632a03047b792a4e2a5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:03:59.749576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1024/2030] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:03:59 2022] DELETE /identity/v3/users/3430fc0169274632a03047b792a4e2a5 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:00.133302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:00.135040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:00.175462 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427713b-86c4-4b1e-b21b-5952027d56d3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:00.243497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:00.249246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.249246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.249246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] PATH_INFO: `/v3/users/6b5dfd0117bc4bac8dc1a7a59ceaf9ea` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.249246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5dfd0117bc4bac8dc1a7a59ceaf9ea)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:00.249246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:00.317978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:00.317978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:00.336956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3a9e-c9a8-4ed6-97f8-9c74a6e3068e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:00.342859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:00.343784 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.344271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.344725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] PATH_INFO: `/v3/projects/96085f2af9c54c44a2263351b713cad4` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.346075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96085f2af9c54c44a2263351b713cad4)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:00.348185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:00.427499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:00.432759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5dfd0117bc4bac8dc1a7a59ceaf9ea'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.439940 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5dfd0117bc4bac8dc1a7a59ceaf9ea'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.440624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5dfd0117bc4bac8dc1a7a59ceaf9ea'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.441228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5dfd0117bc4bac8dc1a7a59ceaf9ea'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.489362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96085f2af9c54c44a2263351b713cad4', 'request_id': 'req-3619a2d4-225d-41db-9d13-5c1c75af3576'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.495724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96085f2af9c54c44a2263351b713cad4', 'request_id': 'req-3619a2d4-225d-41db-9d13-5c1c75af3576'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.503070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96085f2af9c54c44a2263351b713cad4', 'request_id': 'req-3619a2d4-225d-41db-9d13-5c1c75af3576'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.562918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7c8e27c-95f8-4ae1-b3d6-fc819c4c1077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5dfd0117bc4bac8dc1a7a59ceaf9ea'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.611537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1007/2031] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:00 2022] DELETE /identity/v3/users/6b5dfd0117bc4bac8dc1a7a59ceaf9ea => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:00.617689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e75b73-c741-4a80-a44a-03e4e092445a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.618057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e75b73-c741-4a80-a44a-03e4e092445a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.621176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e75b73-c741-4a80-a44a-03e4e092445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.638140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] The token cache is being invalidate because project 96085f2af9c54c44a2263351b713cad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:00.638433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.639083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3619a2d4-225d-41db-9d13-5c1c75af3576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:00.644200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1025/2032] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:00 2022] DELETE /identity/v3/projects/96085f2af9c54c44a2263351b713cad4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:00.646472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351295ff-a14c-4e23-8af1-2f15133d9c0d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.646896 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351295ff-a14c-4e23-8af1-2f15133d9c0d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.647139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351295ff-a14c-4e23-8af1-2f15133d9c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.669556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-351295ff-a14c-4e23-8af1-2f15133d9c0d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:00.670286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-97e75b73-c741-4a80-a44a-03e4e092445a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:00.671136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-351295ff-a14c-4e23-8af1-2f15133d9c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:00.672497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-97e75b73-c741-4a80-a44a-03e4e092445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:00.773390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1026/2033] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:00.784973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f134e-5e44-47a1-9a7b-b7330e084f24 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.785273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f134e-5e44-47a1-9a7b-b7330e084f24 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.785699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f134e-5e44-47a1-9a7b-b7330e084f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.797534 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1008/2034] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:00.815017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e75b73-c741-4a80-a44a-03e4e092445a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:00.819646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-97e75b73-c741-4a80-a44a-03e4e092445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:00.841546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-be3f134e-5e44-47a1-9a7b-b7330e084f24 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:00.843839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-be3f134e-5e44-47a1-9a7b-b7330e084f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:00.857170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1027/2035] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:00.861459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f134e-5e44-47a1-9a7b-b7330e084f24 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:00.885906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f134e-5e44-47a1-9a7b-b7330e084f24 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:00.902331 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40054-28c9-481d-a6a9-496a3b497eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:00.906958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40054-28c9-481d-a6a9-496a3b497eca admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.906958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40054-28c9-481d-a6a9-496a3b497eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.906958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40054-28c9-481d-a6a9-496a3b497eca admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.906958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40054-28c9-481d-a6a9-496a3b497eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:00.906958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40054-28c9-481d-a6a9-496a3b497eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:00.906958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40054-28c9-481d-a6a9-496a3b497eca admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:00.913580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e75b73-c741-4a80-a44a-03e4e092445a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:00.917375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1951b16-eff2-4d9b-8c3d-1b9b86c6abbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:00.918010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1951b16-eff2-4d9b-8c3d-1b9b86c6abbb service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.918287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1951b16-eff2-4d9b-8c3d-1b9b86c6abbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.918550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1951b16-eff2-4d9b-8c3d-1b9b86c6abbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.922620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1028/2036] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:04:00.923595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40054-28c9-481d-a6a9-496a3b497eca admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:00.942462 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40054-28c9-481d-a6a9-496a3b497eca admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:00.944595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1951b16-eff2-4d9b-8c3d-1b9b86c6abbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:00.946103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1951b16-eff2-4d9b-8c3d-1b9b86c6abbb service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:00.950343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef873c-8591-4cb3-9890-fcf83352edad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:00.950971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef873c-8591-4cb3-9890-fcf83352edad admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.951255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef873c-8591-4cb3-9890-fcf83352edad admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.951532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef873c-8591-4cb3-9890-fcf83352edad admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.952721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef873c-8591-4cb3-9890-fcf83352edad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:00.954111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef873c-8591-4cb3-9890-fcf83352edad admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:00.960561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:00.970035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1009/2037] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:00.970999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1951b16-eff2-4d9b-8c3d-1b9b86c6abbb service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:00.972452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b1951b16-eff2-4d9b-8c3d-1b9b86c6abbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:00.987811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1951b16-eff2-4d9b-8c3d-1b9b86c6abbb service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:00.992800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:00.993431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:00.993816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:00.994797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] PATH_INFO: `/v3/users/37e7ea97f58341fc99b168ee30503594` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:00.995968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e7ea97f58341fc99b168ee30503594)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:00.998024 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:01.056441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1029/2038] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:00 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:01.060477 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef873c-8591-4cb3-9890-fcf83352edad admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:01.121724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef873c-8591-4cb3-9890-fcf83352edad admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:01.126520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a7ac0-4d82-4263-9da1-a7c54571f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:01.127120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a7ac0-4d82-4263-9da1-a7c54571f96c admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:01.127397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a7ac0-4d82-4263-9da1-a7c54571f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:01.127917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a7ac0-4d82-4263-9da1-a7c54571f96c admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:01.128540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a7ac0-4d82-4263-9da1-a7c54571f96c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:01.130480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a7ac0-4d82-4263-9da1-a7c54571f96c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:01.319146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1030/2039] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:01 2022] POST /identity/v3/users => generated 281 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:01.322408 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a7ac0-4d82-4263-9da1-a7c54571f96c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:01.330072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e7ea97f58341fc99b168ee30503594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:01.338116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a7ac0-4d82-4263-9da1-a7c54571f96c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:01.346547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcac248-9a60-43dd-a7a1-be88293183a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:01.346547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac248-9a60-43dd-a7a1-be88293183a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:01.346547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac248-9a60-43dd-a7a1-be88293183a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:01.346547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac248-9a60-43dd-a7a1-be88293183a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:01.346932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcac248-9a60-43dd-a7a1-be88293183a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:01.346932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcac248-9a60-43dd-a7a1-be88293183a8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:01.349270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e7ea97f58341fc99b168ee30503594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:01.350029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e7ea97f58341fc99b168ee30503594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:01.353680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e7ea97f58341fc99b168ee30503594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:01.356003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:01.357928 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1031/2040] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:01.361634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcac248-9a60-43dd-a7a1-be88293183a8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:01.370361 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9fcac248-9a60-43dd-a7a1-be88293183a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:01.387692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcac248-9a60-43dd-a7a1-be88293183a8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:01.393181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283c231-d781-4ef3-84c9-0435ee72c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:01.393901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283c231-d781-4ef3-84c9-0435ee72c864 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:01.394187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283c231-d781-4ef3-84c9-0435ee72c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:01.394461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283c231-d781-4ef3-84c9-0435ee72c864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:01.395115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283c231-d781-4ef3-84c9-0435ee72c864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:01.396869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283c231-d781-4ef3-84c9-0435ee72c864 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:01.408775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1032/2041] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:04:01.414108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283c231-d781-4ef3-84c9-0435ee72c864 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:01.424936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283c231-d781-4ef3-84c9-0435ee72c864 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:01.429840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4fe89-a8bb-4363-afbd-c13de8118ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:01.430519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4fe89-a8bb-4363-afbd-c13de8118ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:01.430801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4fe89-a8bb-4363-afbd-c13de8118ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:01.431106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4fe89-a8bb-4363-afbd-c13de8118ae3 admin admin] PATH_INFO: `/v3/projects/20e1657ca9ad4024b2a71d0efdf616da/users/24100e4909474a7cab2ba71138ef5771/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:01.453377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4fe89-a8bb-4363-afbd-c13de8118ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e1657ca9ad4024b2a71d0efdf616da, user_id=24100e4909474a7cab2ba71138ef5771, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:01.456103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4fe89-a8bb-4363-afbd-c13de8118ae3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:01.470571 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e7ea97f58341fc99b168ee30503594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:01.491795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1010/2042] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:00 2022] DELETE /identity/v3/users/37e7ea97f58341fc99b168ee30503594 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:01.586983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:01.589851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:01.592044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1033/2043] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:01 2022] PUT /identity/v3/projects/20e1657ca9ad4024b2a71d0efdf616da/users/24100e4909474a7cab2ba71138ef5771/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:01.603753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fbccc-fd21-4f9e-bb08-bb2b814b5b20 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:01.604034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fbccc-fd21-4f9e-bb08-bb2b814b5b20 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:01.604315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fbccc-fd21-4f9e-bb08-bb2b814b5b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:01.668384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6a6fbccc-fd21-4f9e-bb08-bb2b814b5b20 None None] MFA Rules not processed for user `24100e4909474a7cab2ba71138ef5771`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:01.669832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6a6fbccc-fd21-4f9e-bb08-bb2b814b5b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:01.759044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c26daa-ecfe-4486-8ac2-1ca0d292c955 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:01.781341 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1034/2044] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:01.822762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fbccc-fd21-4f9e-bb08-bb2b814b5b20 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:01.824747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6a6fbccc-fd21-4f9e-bb08-bb2b814b5b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:01.845015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:01.846424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:01.846864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:01.847297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] PATH_INFO: `/v3/projects/38e1fe60e24f4434948240674528a43c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:01.848629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e1fe60e24f4434948240674528a43c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:01.851356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:01.860915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:01.929934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fbccc-fd21-4f9e-bb08-bb2b814b5b20 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:01.936595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d92ca-0980-408e-bfd8-33440786335d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:01.937530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d92ca-0980-408e-bfd8-33440786335d service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:01.938288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d92ca-0980-408e-bfd8-33440786335d service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:01.938428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d92ca-0980-408e-bfd8-33440786335d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:01.961575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d92ca-0980-408e-bfd8-33440786335d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:01.963813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d92ca-0980-408e-bfd8-33440786335d service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:01.980725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1035/2045] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:01.981929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d92ca-0980-408e-bfd8-33440786335d service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:01.988327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-120d92ca-0980-408e-bfd8-33440786335d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:02.010013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d92ca-0980-408e-bfd8-33440786335d service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:02.010426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e1fe60e24f4434948240674528a43c', 'request_id': 'req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.016884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e1fe60e24f4434948240674528a43c', 'request_id': 'req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.035102 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e1fe60e24f4434948240674528a43c', 'request_id': 'req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.085965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:02.086524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.086802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.087070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] PATH_INFO: `/v3/projects/66d1e29bdbed410db1d4c9710b08cbad` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.088387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d1e29bdbed410db1d4c9710b08cbad)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:02.090350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:02.112398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] The token cache is being invalidate because project 38e1fe60e24f4434948240674528a43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:02.123755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.123755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.123755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1011/2046] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:01 2022] DELETE /identity/v3/projects/38e1fe60e24f4434948240674528a43c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:02.123755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:02.123755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:02.132668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef3d9f-bbab-4139-9d6d-f522f3e5d8aa admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:02.137576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:02.138252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.138526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.138803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] PATH_INFO: `/v3/users/24100e4909474a7cab2ba71138ef5771` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.139968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=24100e4909474a7cab2ba71138ef5771)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:02.141920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:02.146928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:02.249649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d1e29bdbed410db1d4c9710b08cbad', 'request_id': 'req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.255968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d1e29bdbed410db1d4c9710b08cbad', 'request_id': 'req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.262255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d1e29bdbed410db1d4c9710b08cbad', 'request_id': 'req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.310547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] The token cache is being invalidate because project 66d1e29bdbed410db1d4c9710b08cbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:02.310834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.311647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e27e8a0d-fc97-49f1-bb9c-0c956a6331b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.322314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1036/2047] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:01 2022] DELETE /identity/v3/projects/66d1e29bdbed410db1d4c9710b08cbad => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:02.322314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded148-775e-49a6-9a6f-0204019e25d3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.322314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded148-775e-49a6-9a6f-0204019e25d3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.322314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded148-775e-49a6-9a6f-0204019e25d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.323261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24100e4909474a7cab2ba71138ef5771'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.329606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24100e4909474a7cab2ba71138ef5771'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.330379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24100e4909474a7cab2ba71138ef5771'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.331051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24100e4909474a7cab2ba71138ef5771'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.341867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-59ded148-775e-49a6-9a6f-0204019e25d3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:02.342999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-59ded148-775e-49a6-9a6f-0204019e25d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:02.385738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a2f55952-c810-481d-a6b1-d47e64beb50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24100e4909474a7cab2ba71138ef5771'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:02.400450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:02.408361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1012/2048] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:02 2022] DELETE /identity/v3/users/24100e4909474a7cab2ba71138ef5771 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:02.409589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092d7fb-5792-40b6-8a23-b682e548b5d3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.409952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092d7fb-5792-40b6-8a23-b682e548b5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.410425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092d7fb-5792-40b6-8a23-b682e548b5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.417090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1037/2049] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:02.419977 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9d04c-11e4-4fcd-abc9-2010fb04ec41 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.426032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9d04c-11e4-4fcd-abc9-2010fb04ec41 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.426320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9d04c-11e4-4fcd-abc9-2010fb04ec41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.436371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c092d7fb-5792-40b6-8a23-b682e548b5d3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:02.437984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c092d7fb-5792-40b6-8a23-b682e548b5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:02.449979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-39c9d04c-11e4-4fcd-abc9-2010fb04ec41 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:02.449979 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-39c9d04c-11e4-4fcd-abc9-2010fb04ec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:02.512972 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1013/2050] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:02.514415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b729-638b-4589-bcec-b7ba856e15ac None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.514701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b729-638b-4589-bcec-b7ba856e15ac None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.515062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429b729-638b-4589-bcec-b7ba856e15ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.526110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1038/2051] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:02.527571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923bd6-76c7-418c-811f-ff92cb46d130 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.528002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923bd6-76c7-418c-811f-ff92cb46d130 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.528446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923bd6-76c7-418c-811f-ff92cb46d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.541222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0429b729-638b-4589-bcec-b7ba856e15ac None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:02.542682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0429b729-638b-4589-bcec-b7ba856e15ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:02.552723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1d923bd6-76c7-418c-811f-ff92cb46d130 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:02.554110 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1d923bd6-76c7-418c-811f-ff92cb46d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:02.554747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1014/2052] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:02.555631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b729-638b-4589-bcec-b7ba856e15ac None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:02.558000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0429b729-638b-4589-bcec-b7ba856e15ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:02.564827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1039/2053] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:02.565708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923bd6-76c7-418c-811f-ff92cb46d130 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:02.577736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923bd6-76c7-418c-811f-ff92cb46d130 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:02.590476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15945e5-1038-4b44-9928-5da90d4b1c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:02.593990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15945e5-1038-4b44-9928-5da90d4b1c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.593990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15945e5-1038-4b44-9928-5da90d4b1c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.593990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15945e5-1038-4b44-9928-5da90d4b1c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.593990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15945e5-1038-4b44-9928-5da90d4b1c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:02.593990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15945e5-1038-4b44-9928-5da90d4b1c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:02.594453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15945e5-1038-4b44-9928-5da90d4b1c2d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:02.607438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1040/2054] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:02.608275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15945e5-1038-4b44-9928-5da90d4b1c2d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:02.618345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15945e5-1038-4b44-9928-5da90d4b1c2d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:02.624358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2fe93-3fcd-4dba-b0f9-f7230d629a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:02.625367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2fe93-3fcd-4dba-b0f9-f7230d629a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.625774 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2fe93-3fcd-4dba-b0f9-f7230d629a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.626209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2fe93-3fcd-4dba-b0f9-f7230d629a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.626741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2fe93-3fcd-4dba-b0f9-f7230d629a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:02.627045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2fe93-3fcd-4dba-b0f9-f7230d629a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:02.628976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2fe93-3fcd-4dba-b0f9-f7230d629a26 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:02.629365 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429b729-638b-4589-bcec-b7ba856e15ac None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:02.633173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60f425-293f-4dfe-be4f-92c338d7848c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:02.633829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60f425-293f-4dfe-be4f-92c338d7848c service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.634302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60f425-293f-4dfe-be4f-92c338d7848c service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.635260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60f425-293f-4dfe-be4f-92c338d7848c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.642508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1041/2055] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:02.645639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2fe93-3fcd-4dba-b0f9-f7230d629a26 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:02.645754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60f425-293f-4dfe-be4f-92c338d7848c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:02.646953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60f425-293f-4dfe-be4f-92c338d7848c service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:02.653830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2fe93-3fcd-4dba-b0f9-f7230d629a26 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:02.657934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1015/2056] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:02.658799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60f425-293f-4dfe-be4f-92c338d7848c service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:02.660179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022eb4c7-f7eb-4314-8983-bddb510506b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:02.660776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022eb4c7-f7eb-4314-8983-bddb510506b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.661055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022eb4c7-f7eb-4314-8983-bddb510506b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.661331 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022eb4c7-f7eb-4314-8983-bddb510506b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.661992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022eb4c7-f7eb-4314-8983-bddb510506b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:02.664092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022eb4c7-f7eb-4314-8983-bddb510506b9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:02.669849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60f425-293f-4dfe-be4f-92c338d7848c service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:02.677524 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659faf-ecb1-4f11-807b-32cd26e0c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:02.677524 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659faf-ecb1-4f11-807b-32cd26e0c791 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.677524 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659faf-ecb1-4f11-807b-32cd26e0c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.677524 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659faf-ecb1-4f11-807b-32cd26e0c791 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.677918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e659faf-ecb1-4f11-807b-32cd26e0c791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:02.679699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e659faf-ecb1-4f11-807b-32cd26e0c791 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:02.776005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1042/2057] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:02 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:02.780057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022eb4c7-f7eb-4314-8983-bddb510506b9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:02.796993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:02.810332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1016/2058] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:02 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:02.813280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659faf-ecb1-4f11-807b-32cd26e0c791 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:02.848088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022eb4c7-f7eb-4314-8983-bddb510506b9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:02.882225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659faf-ecb1-4f11-807b-32cd26e0c791 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:02.888677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca58d01-f72d-410f-bed9-3022d7924502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:02.889374 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca58d01-f72d-410f-bed9-3022d7924502 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.889749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca58d01-f72d-410f-bed9-3022d7924502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.890089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca58d01-f72d-410f-bed9-3022d7924502 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.890862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca58d01-f72d-410f-bed9-3022d7924502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:02.892800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca58d01-f72d-410f-bed9-3022d7924502 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:02.906157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:02.922575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd244c46-6b81-4c31-95bb-104899817d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:02.923187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd244c46-6b81-4c31-95bb-104899817d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:02.923490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd244c46-6b81-4c31-95bb-104899817d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:02.923757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd244c46-6b81-4c31-95bb-104899817d12 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:02.924556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd244c46-6b81-4c31-95bb-104899817d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:02.926412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd244c46-6b81-4c31-95bb-104899817d12 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.006236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1017/2059] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:02 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:03.007537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca58d01-f72d-410f-bed9-3022d7924502 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.017872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca58d01-f72d-410f-bed9-3022d7924502 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.022567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f647f-67ae-410c-9457-400ed3358449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.023186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f647f-67ae-410c-9457-400ed3358449 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.023656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f647f-67ae-410c-9457-400ed3358449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.023935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f647f-67ae-410c-9457-400ed3358449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.024569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f647f-67ae-410c-9457-400ed3358449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.026686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f647f-67ae-410c-9457-400ed3358449 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.031753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1043/2060] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:02 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:03.038469 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1018/2061] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:03.039935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd244c46-6b81-4c31-95bb-104899817d12 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.043559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f647f-67ae-410c-9457-400ed3358449 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.052614 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd244c46-6b81-4c31-95bb-104899817d12 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.053104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f647f-67ae-410c-9457-400ed3358449 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.058413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43861def-678a-4fbf-9619-6b6ff4535922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.061368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43861def-678a-4fbf-9619-6b6ff4535922 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.061368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43861def-678a-4fbf-9619-6b6ff4535922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.061368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43861def-678a-4fbf-9619-6b6ff4535922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.061368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43861def-678a-4fbf-9619-6b6ff4535922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.061919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85163ac-b727-4bdb-b31e-0393fccfbe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.061919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85163ac-b727-4bdb-b31e-0393fccfbe19 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.062120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43861def-678a-4fbf-9619-6b6ff4535922 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.062321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85163ac-b727-4bdb-b31e-0393fccfbe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.062615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85163ac-b727-4bdb-b31e-0393fccfbe19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.063722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85163ac-b727-4bdb-b31e-0393fccfbe19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.065291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85163ac-b727-4bdb-b31e-0393fccfbe19 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.075175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1044/2062] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:03.077229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1019/2063] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:03.079150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43861def-678a-4fbf-9619-6b6ff4535922 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.084992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85163ac-b727-4bdb-b31e-0393fccfbe19 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.090843 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43861def-678a-4fbf-9619-6b6ff4535922 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.096239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d293cf-1731-422b-818f-201001bf6a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.096845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d293cf-1731-422b-818f-201001bf6a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.096965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85163ac-b727-4bdb-b31e-0393fccfbe19 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.097134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d293cf-1731-422b-818f-201001bf6a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.097378 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d293cf-1731-422b-818f-201001bf6a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.098158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d293cf-1731-422b-818f-201001bf6a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.099847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d293cf-1731-422b-818f-201001bf6a15 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.101653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126be5b7-8196-4020-9c05-72bb6b20e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.102346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be5b7-8196-4020-9c05-72bb6b20e662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.102623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be5b7-8196-4020-9c05-72bb6b20e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.102894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126be5b7-8196-4020-9c05-72bb6b20e662 admin admin] PATH_INFO: `/v3/projects/758266e2ed4b4c0995aae938409ce499/users/f98b5c461b014fd6962da1b044afed9e/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.111497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1045/2064] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:04:03.115559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d293cf-1731-422b-818f-201001bf6a15 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.119274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126be5b7-8196-4020-9c05-72bb6b20e662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758266e2ed4b4c0995aae938409ce499, user_id=f98b5c461b014fd6962da1b044afed9e, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.122048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126be5b7-8196-4020-9c05-72bb6b20e662 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.127401 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d293cf-1731-422b-818f-201001bf6a15 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.139880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf5db-fb69-4693-a35c-63011a694986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.139880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf5db-fb69-4693-a35c-63011a694986 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.139880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf5db-fb69-4693-a35c-63011a694986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.139880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf5db-fb69-4693-a35c-63011a694986 admin admin] PATH_INFO: `/v3/projects/3da775e1559c4a009c082b8cdbb34c43/users/451e4b1ddb5e4a65b527ad292b7803a4/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.155736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf5db-fb69-4693-a35c-63011a694986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da775e1559c4a009c082b8cdbb34c43, user_id=451e4b1ddb5e4a65b527ad292b7803a4, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.158630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf5db-fb69-4693-a35c-63011a694986 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.208260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1020/2065] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:03 2022] PUT /identity/v3/projects/758266e2ed4b4c0995aae938409ce499/users/f98b5c461b014fd6962da1b044afed9e/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:03.210607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126be5b7-8196-4020-9c05-72bb6b20e662 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.211358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-126be5b7-8196-4020-9c05-72bb6b20e662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:03.240509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1046/2066] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:03 2022] PUT /identity/v3/projects/3da775e1559c4a009c082b8cdbb34c43/users/451e4b1ddb5e4a65b527ad292b7803a4/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:03.242484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef74b03-60b6-43a6-bfbf-811851293625 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.242878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef74b03-60b6-43a6-bfbf-811851293625 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.243344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef74b03-60b6-43a6-bfbf-811851293625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.272465 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5ef74b03-60b6-43a6-bfbf-811851293625 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:03.273986 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5ef74b03-60b6-43a6-bfbf-811851293625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:03.297148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126be5b7-8196-4020-9c05-72bb6b20e662 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.383773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.385284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.385618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.385946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] PATH_INFO: `/v3/projects/20e1657ca9ad4024b2a71d0efdf616da` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.387909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e1657ca9ad4024b2a71d0efdf616da)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.390457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.391336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1047/2067] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:03.392915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a53a5-b943-41c6-a0dc-d565bdb56deb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.393206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a53a5-b943-41c6-a0dc-d565bdb56deb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.393500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a53a5-b943-41c6-a0dc-d565bdb56deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.436962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-949a53a5-b943-41c6-a0dc-d565bdb56deb None None] MFA Rules not processed for user `451e4b1ddb5e4a65b527ad292b7803a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:03.438353 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-949a53a5-b943-41c6-a0dc-d565bdb56deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:03.514069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1048/2068] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:03.515004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a53a5-b943-41c6-a0dc-d565bdb56deb None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.544072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e1657ca9ad4024b2a71d0efdf616da', 'request_id': 'req-7f232e43-b282-440a-b15c-5bb4ff4b9079'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:03.549834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e1657ca9ad4024b2a71d0efdf616da', 'request_id': 'req-7f232e43-b282-440a-b15c-5bb4ff4b9079'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:03.555996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e1657ca9ad4024b2a71d0efdf616da', 'request_id': 'req-7f232e43-b282-440a-b15c-5bb4ff4b9079'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:03.570251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a53a5-b943-41c6-a0dc-d565bdb56deb None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.619551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8378cba-b244-482f-ae5c-31e016a3488d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.620463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8378cba-b244-482f-ae5c-31e016a3488d service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.620742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8378cba-b244-482f-ae5c-31e016a3488d service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.621014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8378cba-b244-482f-ae5c-31e016a3488d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.653104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] The token cache is being invalidate because project 20e1657ca9ad4024b2a71d0efdf616da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:03.653496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:03.654242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:03.655921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1021/2069] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:03 2022] DELETE /identity/v3/projects/20e1657ca9ad4024b2a71d0efdf616da => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:03.656679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.658029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:03.687312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8378cba-b244-482f-ae5c-31e016a3488d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.688766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8378cba-b244-482f-ae5c-31e016a3488d service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.695288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:03.700676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1049/2070] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:03.702054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf192-db71-4213-9926-67650d281249 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.702338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf192-db71-4213-9926-67650d281249 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.702615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf192-db71-4213-9926-67650d281249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.717691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f232e43-b282-440a-b15c-5bb4ff4b9079 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.721829 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:03.722961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d0eaf192-db71-4213-9926-67650d281249 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:03.723758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738390d4-7a3f-422b-bf7a-cc356bb6ba0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79bb81300cff46b7ba1680eedf2762cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.724317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d0eaf192-db71-4213-9926-67650d281249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:03.724797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738390d4-7a3f-422b-bf7a-cc356bb6ba0f service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.725435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738390d4-7a3f-422b-bf7a-cc356bb6ba0f service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.729675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738390d4-7a3f-422b-bf7a-cc356bb6ba0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.729675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-738390d4-7a3f-422b-bf7a-cc356bb6ba0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:03.733388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1050/2071] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:03.741500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac5c29-1e10-40b1-b364-9f94e591fdfa None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.741814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac5c29-1e10-40b1-b364-9f94e591fdfa None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.742194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac5c29-1e10-40b1-b364-9f94e591fdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.763415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-73ac5c29-1e10-40b1-b364-9f94e591fdfa None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:03.764640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-73ac5c29-1e10-40b1-b364-9f94e591fdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:03.772651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1051/2072] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:04:03.776978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac5c29-1e10-40b1-b364-9f94e591fdfa None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.786034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac5c29-1e10-40b1-b364-9f94e591fdfa None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.789390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738390d4-7a3f-422b-bf7a-cc356bb6ba0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.791715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738390d4-7a3f-422b-bf7a-cc356bb6ba0f service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.792063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e0acc-fa6f-4b2e-9295-6e63e7fd2bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.792666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e0acc-fa6f-4b2e-9295-6e63e7fd2bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.792947 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e0acc-fa6f-4b2e-9295-6e63e7fd2bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.793220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e0acc-fa6f-4b2e-9295-6e63e7fd2bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.793907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e0acc-fa6f-4b2e-9295-6e63e7fd2bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:03.796580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e0acc-fa6f-4b2e-9295-6e63e7fd2bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.796580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e0acc-fa6f-4b2e-9295-6e63e7fd2bf1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.801782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1022/2073] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:03.812102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1052/2074] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:04:03.813359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738390d4-7a3f-422b-bf7a-cc356bb6ba0f service glance] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.826042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738390d4-7a3f-422b-bf7a-cc356bb6ba0f service glance] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:03.834827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893affc-f4a9-4934-86d1-8f8cf4ed6896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:03.834827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893affc-f4a9-4934-86d1-8f8cf4ed6896 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:03.834827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893affc-f4a9-4934-86d1-8f8cf4ed6896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:03.834827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893affc-f4a9-4934-86d1-8f8cf4ed6896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:03.835174 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893affc-f4a9-4934-86d1-8f8cf4ed6896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:03.835922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893affc-f4a9-4934-86d1-8f8cf4ed6896 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:03.946960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1023/2075] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:03 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:03.951198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e0acc-fa6f-4b2e-9295-6e63e7fd2bf1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:03.961858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e0acc-fa6f-4b2e-9295-6e63e7fd2bf1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:04.031327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a525a-034e-4939-b180-b9553bb712c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:04.032641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a525a-034e-4939-b180-b9553bb712c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:04.032641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a525a-034e-4939-b180-b9553bb712c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:04.032974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a525a-034e-4939-b180-b9553bb712c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:04.033795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a525a-034e-4939-b180-b9553bb712c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:04.036354 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a525a-034e-4939-b180-b9553bb712c4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:04.140737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1053/2076] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:03 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:04.145793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893affc-f4a9-4934-86d1-8f8cf4ed6896 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:04.157067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893affc-f4a9-4934-86d1-8f8cf4ed6896 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:04.161922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062badf6-2587-4f85-91a0-9eeb004bc062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:04.162529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062badf6-2587-4f85-91a0-9eeb004bc062 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:04.162808 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062badf6-2587-4f85-91a0-9eeb004bc062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:04.163078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062badf6-2587-4f85-91a0-9eeb004bc062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:04.163750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062badf6-2587-4f85-91a0-9eeb004bc062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:04.165341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062badf6-2587-4f85-91a0-9eeb004bc062 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:04.181318 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1024/2077] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:04.183241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a525a-034e-4939-b180-b9553bb712c4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:04.194060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a525a-034e-4939-b180-b9553bb712c4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:04.198973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1adc0a-4f58-4d2a-8f0f-a8d62a730f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:04.199570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1adc0a-4f58-4d2a-8f0f-a8d62a730f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:04.199850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1adc0a-4f58-4d2a-8f0f-a8d62a730f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:04.200121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1adc0a-4f58-4d2a-8f0f-a8d62a730f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:04.200789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1adc0a-4f58-4d2a-8f0f-a8d62a730f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:04.202419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1adc0a-4f58-4d2a-8f0f-a8d62a730f7a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:04.214593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1054/2078] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:04.218914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062badf6-2587-4f85-91a0-9eeb004bc062 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:04.231177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062badf6-2587-4f85-91a0-9eeb004bc062 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:04.236102 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea182401-0f3c-4cbf-9ea9-5bdd95972a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:04.239412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea182401-0f3c-4cbf-9ea9-5bdd95972a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:04.239412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea182401-0f3c-4cbf-9ea9-5bdd95972a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:04.239412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea182401-0f3c-4cbf-9ea9-5bdd95972a61 admin admin] PATH_INFO: `/v3/projects/027fd809d2d34eed80b93dd7d91dd1d6/users/e91fee96d1b04d4aa9f647270f5f618f/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:04.252190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea182401-0f3c-4cbf-9ea9-5bdd95972a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027fd809d2d34eed80b93dd7d91dd1d6, user_id=e91fee96d1b04d4aa9f647270f5f618f, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:04.255144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea182401-0f3c-4cbf-9ea9-5bdd95972a61 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:04.355276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1025/2079] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:04 2022] PUT /identity/v3/projects/027fd809d2d34eed80b93dd7d91dd1d6/users/e91fee96d1b04d4aa9f647270f5f618f/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:04.367823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2486fd1-0e46-4f4e-b87e-79565a0e3494 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:04.369833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2486fd1-0e46-4f4e-b87e-79565a0e3494 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:04.370181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2486fd1-0e46-4f4e-b87e-79565a0e3494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:04.402005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a2486fd1-0e46-4f4e-b87e-79565a0e3494 None None] MFA Rules not processed for user `e91fee96d1b04d4aa9f647270f5f618f`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:04.403233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a2486fd1-0e46-4f4e-b87e-79565a0e3494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:04.483743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1055/2080] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:04.497251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea182401-0f3c-4cbf-9ea9-5bdd95972a61 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:04.564895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea182401-0f3c-4cbf-9ea9-5bdd95972a61 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:04.569233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a960db-b84c-4de9-8466-184c5fcfc1a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79bb81300cff46b7ba1680eedf2762cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:04.570092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a960db-b84c-4de9-8466-184c5fcfc1a5 service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:04.570561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a960db-b84c-4de9-8466-184c5fcfc1a5 service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:04.570987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a960db-b84c-4de9-8466-184c5fcfc1a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:04.581067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a960db-b84c-4de9-8466-184c5fcfc1a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:04.583009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a960db-b84c-4de9-8466-184c5fcfc1a5 service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:04.597832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1026/2081] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:04.826230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:04.972585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:09.882402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da855f-9eaf-43ca-9ba6-8900896b7287 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:09.882866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da855f-9eaf-43ca-9ba6-8900896b7287 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:09.883252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da855f-9eaf-43ca-9ba6-8900896b7287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:09.932810 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-40da855f-9eaf-43ca-9ba6-8900896b7287 None None] MFA Rules not processed for user `f98b5c461b014fd6962da1b044afed9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:09.937600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-40da855f-9eaf-43ca-9ba6-8900896b7287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:10.017784 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1056/2082] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:10.034430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a960db-b84c-4de9-8466-184c5fcfc1a5 service glance] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:10.035946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-83a960db-b84c-4de9-8466-184c5fcfc1a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:10.141334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a960db-b84c-4de9-8466-184c5fcfc1a5 service glance] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:10.145071 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d483398-8c49-4efe-be72-df6aecb02fd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:10.145836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483398-8c49-4efe-be72-df6aecb02fd2 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:10.146182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483398-8c49-4efe-be72-df6aecb02fd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:10.146527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483398-8c49-4efe-be72-df6aecb02fd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:10.155725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d483398-8c49-4efe-be72-df6aecb02fd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:10.157448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d483398-8c49-4efe-be72-df6aecb02fd2 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:10.168589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1027/2083] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:11.441387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da855f-9eaf-43ca-9ba6-8900896b7287 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:11.443884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-40da855f-9eaf-43ca-9ba6-8900896b7287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:11.543585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da855f-9eaf-43ca-9ba6-8900896b7287 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:11.547072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:11.547694 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:11.547969 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:11.548240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:11.551166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:11.564185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:11.721797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:11.723319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:11.747885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1057/2084] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:12.932453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60791a-5bf6-40b9-a5c8-a7996ac970bd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:12.933490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60791a-5bf6-40b9-a5c8-a7996ac970bd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:12.934007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60791a-5bf6-40b9-a5c8-a7996ac970bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:12.955606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0a60791a-5bf6-40b9-a5c8-a7996ac970bd None None] MFA Rules not processed for user `f98b5c461b014fd6962da1b044afed9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:12.956837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0a60791a-5bf6-40b9-a5c8-a7996ac970bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:12.972706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1028/2085] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:22.240908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=24 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:22.948914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:41.307238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.308901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:41.399179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2868246-f06b-4928-a4d1-64599d71b1bd service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.404976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.405966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.406395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.406809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] PATH_INFO: `/v3/users/fa26df86a0ef479f879972f3b9f12fa3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.408502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa26df86a0ef479f879972f3b9f12fa3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.411286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.678277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa26df86a0ef479f879972f3b9f12fa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:41.678942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa26df86a0ef479f879972f3b9f12fa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:41.679549 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa26df86a0ef479f879972f3b9f12fa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:41.748800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa841163-e8ec-4778-9d57-51db3454dfa4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.754521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa841163-e8ec-4778-9d57-51db3454dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.754521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa841163-e8ec-4778-9d57-51db3454dfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.770894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-aa841163-e8ec-4778-9d57-51db3454dfa4 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:41.772298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aa841163-e8ec-4778-9d57-51db3454dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:41.781581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1029/2086] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:41.801602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa26df86a0ef479f879972f3b9f12fa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:41.813219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa841163-e8ec-4778-9d57-51db3454dfa4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:41.815053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aa841163-e8ec-4778-9d57-51db3454dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:41.823807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa26df86a0ef479f879972f3b9f12fa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:41.838053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa841163-e8ec-4778-9d57-51db3454dfa4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:41.840991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1058/2087] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:41 2022] DELETE /identity/v3/users/fa26df86a0ef479f879972f3b9f12fa3 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:41.849067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294d1f8-a701-421d-afee-f43245aa998b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:41.849067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294d1f8-a701-421d-afee-f43245aa998b service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:41.849626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294d1f8-a701-421d-afee-f43245aa998b service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:41.850115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294d1f8-a701-421d-afee-f43245aa998b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:41.860258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294d1f8-a701-421d-afee-f43245aa998b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:41.862926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294d1f8-a701-421d-afee-f43245aa998b service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:41.878953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1030/2088] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:42.254985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:42.257172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:42.337309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017900b0-5bfa-4779-9e27-96f1195471e5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:42.342374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:42.343005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:42.343272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:42.343540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] PATH_INFO: `/v3/projects/e83db33f39c24b638403721230239959` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:42.344663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83db33f39c24b638403721230239959)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:42.346591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:42.372312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:42.446613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83db33f39c24b638403721230239959', 'request_id': 'req-4924df88-ee40-4987-b596-c46bda997a56'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.455036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83db33f39c24b638403721230239959', 'request_id': 'req-4924df88-ee40-4987-b596-c46bda997a56'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.461739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83db33f39c24b638403721230239959', 'request_id': 'req-4924df88-ee40-4987-b596-c46bda997a56'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.544065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] The token cache is being invalidate because project e83db33f39c24b638403721230239959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:42.544351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.545146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.546650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1059/2089] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:42 2022] DELETE /identity/v3/projects/e83db33f39c24b638403721230239959 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:42.550725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294d1f8-a701-421d-afee-f43245aa998b service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:42.560592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294d1f8-a701-421d-afee-f43245aa998b service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:42.618733 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:42.619329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:42.619815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:42.620201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] PATH_INFO: `/v3/users/fc94ed06a975437298a6386f8813b1a9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:42.621401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc94ed06a975437298a6386f8813b1a9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:42.623747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:42.845179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc94ed06a975437298a6386f8813b1a9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.852469 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc94ed06a975437298a6386f8813b1a9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.853080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc94ed06a975437298a6386f8813b1a9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.853715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc94ed06a975437298a6386f8813b1a9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.909955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bea3651c-660b-46e9-a417-5f18fb57be67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc94ed06a975437298a6386f8813b1a9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:42.934343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1031/2090] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:42 2022] DELETE /identity/v3/users/fc94ed06a975437298a6386f8813b1a9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:04:43.184330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:43.185823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:43.200732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924df88-ee40-4987-b596-c46bda997a56 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:43.281594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:43.282256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.282534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.282804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] PATH_INFO: `/v3/projects/0470131df53844d2b84430908f99e300` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.284098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0470131df53844d2b84430908f99e300)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:43.286566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:43.448652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0470131df53844d2b84430908f99e300', 'request_id': 'req-67b61d4a-d739-444c-999b-914d6da5e104'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.454939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0470131df53844d2b84430908f99e300', 'request_id': 'req-67b61d4a-d739-444c-999b-914d6da5e104'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.461234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0470131df53844d2b84430908f99e300', 'request_id': 'req-67b61d4a-d739-444c-999b-914d6da5e104'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.555578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] The token cache is being invalidate because project 0470131df53844d2b84430908f99e300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:43.555940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.556604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-67b61d4a-d739-444c-999b-914d6da5e104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:43.558187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1060/2091] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:43 2022] DELETE /identity/v3/projects/0470131df53844d2b84430908f99e300 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:43.563885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d30d5-130d-49e1-87e2-eaf3c497d5e8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.564217 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d30d5-130d-49e1-87e2-eaf3c497d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.564509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d30d5-130d-49e1-87e2-eaf3c497d5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.584524 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-760d30d5-130d-49e1-87e2-eaf3c497d5e8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:43.585729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-760d30d5-130d-49e1-87e2-eaf3c497d5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:43.642300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:43.650572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1032/2092] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:43.658745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad8893-2aeb-4bc1-a740-de39307e7ad4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.659025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad8893-2aeb-4bc1-a740-de39307e7ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.659296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad8893-2aeb-4bc1-a740-de39307e7ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.679203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-13ad8893-2aeb-4bc1-a740-de39307e7ad4 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:43.680694 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-13ad8893-2aeb-4bc1-a740-de39307e7ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:43.689445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1061/2093] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:43.693673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d30d5-130d-49e1-87e2-eaf3c497d5e8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:43.704157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d30d5-130d-49e1-87e2-eaf3c497d5e8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:43.709731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac3cb6-be93-450a-adc3-7387407a1922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:43.710366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac3cb6-be93-450a-adc3-7387407a1922 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.710646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac3cb6-be93-450a-adc3-7387407a1922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.723340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac3cb6-be93-450a-adc3-7387407a1922 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.723340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac3cb6-be93-450a-adc3-7387407a1922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:43.723340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac3cb6-be93-450a-adc3-7387407a1922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:43.723340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac3cb6-be93-450a-adc3-7387407a1922 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:43.726648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1033/2094] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:43.731059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad8893-2aeb-4bc1-a740-de39307e7ad4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:43.741996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad8893-2aeb-4bc1-a740-de39307e7ad4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:43.749485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2360d25-92f5-476a-89b2-b6aff10b5a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:43.750094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2360d25-92f5-476a-89b2-b6aff10b5a46 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.750372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2360d25-92f5-476a-89b2-b6aff10b5a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.764211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2360d25-92f5-476a-89b2-b6aff10b5a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.764904 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2360d25-92f5-476a-89b2-b6aff10b5a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:43.766682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2360d25-92f5-476a-89b2-b6aff10b5a46 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:43.893437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1062/2095] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:43 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:43.896891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac3cb6-be93-450a-adc3-7387407a1922 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:43.906996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac3cb6-be93-450a-adc3-7387407a1922 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:43.968175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8a513-50d1-459a-b83d-2a4970492430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:43.968175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8a513-50d1-459a-b83d-2a4970492430 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:43.968175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8a513-50d1-459a-b83d-2a4970492430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:43.968175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8a513-50d1-459a-b83d-2a4970492430 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:43.968548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8a513-50d1-459a-b83d-2a4970492430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:43.970531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8a513-50d1-459a-b83d-2a4970492430 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:44.122222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1034/2096] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:43 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:44.127477 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2360d25-92f5-476a-89b2-b6aff10b5a46 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:44.139094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2360d25-92f5-476a-89b2-b6aff10b5a46 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:44.144582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725964c8-1740-491c-8c53-f8c2b19fc211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:44.145419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725964c8-1740-491c-8c53-f8c2b19fc211 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:44.145736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725964c8-1740-491c-8c53-f8c2b19fc211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:44.146012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725964c8-1740-491c-8c53-f8c2b19fc211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:44.146673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725964c8-1740-491c-8c53-f8c2b19fc211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:44.148276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725964c8-1740-491c-8c53-f8c2b19fc211 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:44.154138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:44.159505 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1063/2097] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:44.166210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8a513-50d1-459a-b83d-2a4970492430 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:44.176896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8a513-50d1-459a-b83d-2a4970492430 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:44.181742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e95931-b61b-4c45-b4f0-79435d503e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:44.182372 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e95931-b61b-4c45-b4f0-79435d503e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:44.182697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e95931-b61b-4c45-b4f0-79435d503e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:44.182950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e95931-b61b-4c45-b4f0-79435d503e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:44.183586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e95931-b61b-4c45-b4f0-79435d503e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:44.185865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e95931-b61b-4c45-b4f0-79435d503e9c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:44.197159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1035/2098] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:44.202192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725964c8-1740-491c-8c53-f8c2b19fc211 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:44.213136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725964c8-1740-491c-8c53-f8c2b19fc211 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:44.218527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ae47-1ec4-4adc-a514-cb9c006b897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:44.219116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ae47-1ec4-4adc-a514-cb9c006b897d admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:44.219395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ae47-1ec4-4adc-a514-cb9c006b897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:44.219669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14ae47-1ec4-4adc-a514-cb9c006b897d admin admin] PATH_INFO: `/v3/projects/d826ac40b60a4c948117fba52659b347/users/942b805b400042238a94cc1955a7a709/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:44.235076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14ae47-1ec4-4adc-a514-cb9c006b897d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d826ac40b60a4c948117fba52659b347, user_id=942b805b400042238a94cc1955a7a709, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:44.237886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14ae47-1ec4-4adc-a514-cb9c006b897d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:44.356622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1064/2099] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:44 2022] PUT /identity/v3/projects/d826ac40b60a4c948117fba52659b347/users/942b805b400042238a94cc1955a7a709/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:44.362650 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76ddaf-d833-4f88-aa94-94f8f1bce7d6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:44.363731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76ddaf-d833-4f88-aa94-94f8f1bce7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:44.364366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76ddaf-d833-4f88-aa94-94f8f1bce7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:44.384855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1a76ddaf-d833-4f88-aa94-94f8f1bce7d6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:44.386173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1a76ddaf-d833-4f88-aa94-94f8f1bce7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:44.448077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1036/2100] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:44.458547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ae47-1ec4-4adc-a514-cb9c006b897d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:44.460429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bb14ae47-1ec4-4adc-a514-cb9c006b897d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:44.523621 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14ae47-1ec4-4adc-a514-cb9c006b897d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:44.527267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0abaad-61d2-47cc-83df-0335c6a351f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:44.527871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0abaad-61d2-47cc-83df-0335c6a351f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:44.528152 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0abaad-61d2-47cc-83df-0335c6a351f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:44.528425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0abaad-61d2-47cc-83df-0335c6a351f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:44.538596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0abaad-61d2-47cc-83df-0335c6a351f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:44.540019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0abaad-61d2-47cc-83df-0335c6a351f0 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:44.550306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1065/2101] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:46.111665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0339eeb-eaf3-48d9-85ff-8f93bfa4b1e2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.112184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0339eeb-eaf3-48d9-85ff-8f93bfa4b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.112407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0339eeb-eaf3-48d9-85ff-8f93bfa4b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.143741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a0339eeb-eaf3-48d9-85ff-8f93bfa4b1e2 None None] MFA Rules not processed for user `942b805b400042238a94cc1955a7a709`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:46.145276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a0339eeb-eaf3-48d9-85ff-8f93bfa4b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.207308 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:46.216725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1037/2102] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:46.228382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0abaad-61d2-47cc-83df-0335c6a351f0 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.229828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5b0abaad-61d2-47cc-83df-0335c6a351f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.288288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0abaad-61d2-47cc-83df-0335c6a351f0 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.291952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c706581-9ef1-42ce-b42d-2ae0670e55d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.292550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c706581-9ef1-42ce-b42d-2ae0670e55d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.292824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c706581-9ef1-42ce-b42d-2ae0670e55d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.293093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c706581-9ef1-42ce-b42d-2ae0670e55d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.301751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c706581-9ef1-42ce-b42d-2ae0670e55d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.303181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c706581-9ef1-42ce-b42d-2ae0670e55d1 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.312497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1066/2103] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:46.671603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0339eeb-eaf3-48d9-85ff-8f93bfa4b1e2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.673034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a0339eeb-eaf3-48d9-85ff-8f93bfa4b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.687454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0339eeb-eaf3-48d9-85ff-8f93bfa4b1e2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.692353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.692980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.693261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.693569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] PATH_INFO: `/v3/users/451e4b1ddb5e4a65b527ad292b7803a4` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.694691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451e4b1ddb5e4a65b527ad292b7803a4)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.696629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.915868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451e4b1ddb5e4a65b527ad292b7803a4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.923861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451e4b1ddb5e4a65b527ad292b7803a4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.927501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451e4b1ddb5e4a65b527ad292b7803a4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:46.928019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451e4b1ddb5e4a65b527ad292b7803a4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.012894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a84c1926-27a7-45cc-992d-5f318a4cf200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451e4b1ddb5e4a65b527ad292b7803a4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.040332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1038/2104] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:46 2022] DELETE /identity/v3/users/451e4b1ddb5e4a65b527ad292b7803a4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:47.044885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4dbc-6d02-455a-aa12-1326babed8ef None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.045230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4dbc-6d02-455a-aa12-1326babed8ef None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.045663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4dbc-6d02-455a-aa12-1326babed8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.067779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-785c4dbc-6d02-455a-aa12-1326babed8ef None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.068668 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-785c4dbc-6d02-455a-aa12-1326babed8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.120233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762230d-3934-4160-9076-479ee9b9efef None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.121227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762230d-3934-4160-9076-479ee9b9efef None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.121727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762230d-3934-4160-9076-479ee9b9efef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.158015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d762230d-3934-4160-9076-479ee9b9efef None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.159528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d762230d-3934-4160-9076-479ee9b9efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.161916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1067/2105] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:47.168285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1039/2106] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:04:47.171759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c4dbc-6d02-455a-aa12-1326babed8ef None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.174748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-785c4dbc-6d02-455a-aa12-1326babed8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.195606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762230d-3934-4160-9076-479ee9b9efef None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.196996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d762230d-3934-4160-9076-479ee9b9efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.204707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:47.237720 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c4dbc-6d02-455a-aa12-1326babed8ef None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.243423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726eb1f-b9b6-4fb3-9284-d738237ba1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.244248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726eb1f-b9b6-4fb3-9284-d738237ba1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.244672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726eb1f-b9b6-4fb3-9284-d738237ba1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.245224 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726eb1f-b9b6-4fb3-9284-d738237ba1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.256853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726eb1f-b9b6-4fb3-9284-d738237ba1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.258575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726eb1f-b9b6-4fb3-9284-d738237ba1c3 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.269273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1068/2107] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:47.293229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762230d-3934-4160-9076-479ee9b9efef None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.293653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abb02e-6567-4473-b7b0-f2e6b35dca4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.294254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abb02e-6567-4473-b7b0-f2e6b35dca4c service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.294528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abb02e-6567-4473-b7b0-f2e6b35dca4c service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.294801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abb02e-6567-4473-b7b0-f2e6b35dca4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.303380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abb02e-6567-4473-b7b0-f2e6b35dca4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.304992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abb02e-6567-4473-b7b0-f2e6b35dca4c service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.318305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1040/2108] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:47.706603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726eb1f-b9b6-4fb3-9284-d738237ba1c3 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.709066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f726eb1f-b9b6-4fb3-9284-d738237ba1c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.723630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726eb1f-b9b6-4fb3-9284-d738237ba1c3 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.730321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.731013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.731295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.731726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] PATH_INFO: `/v3/projects/3da775e1559c4a009c082b8cdbb34c43` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.732922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da775e1559c4a009c082b8cdbb34c43)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.736062 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.843294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da775e1559c4a009c082b8cdbb34c43', 'request_id': 'req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.849378 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da775e1559c4a009c082b8cdbb34c43', 'request_id': 'req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.855935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da775e1559c4a009c082b8cdbb34c43', 'request_id': 'req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.920771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] The token cache is being invalidate because project 3da775e1559c4a009c082b8cdbb34c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:47.921064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.921950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ffbc7fbf-6cf7-4b45-986c-f78cd117ee72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:47.924114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1069/2109] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:47 2022] DELETE /identity/v3/projects/3da775e1559c4a009c082b8cdbb34c43 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:47.929023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70613550-6bd2-4836-b522-cda3d86d873a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.929307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70613550-6bd2-4836-b522-cda3d86d873a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.929612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70613550-6bd2-4836-b522-cda3d86d873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.950534 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-70613550-6bd2-4836-b522-cda3d86d873a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.951741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-70613550-6bd2-4836-b522-cda3d86d873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.995027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:48.013011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1041/2110] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:48.021034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2b7e5-4b9d-48c6-b7af-e81d4f64f861 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.021321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2b7e5-4b9d-48c6-b7af-e81d4f64f861 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.021636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2b7e5-4b9d-48c6-b7af-e81d4f64f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.042900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-46e2b7e5-4b9d-48c6-b7af-e81d4f64f861 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:48.044107 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-46e2b7e5-4b9d-48c6-b7af-e81d4f64f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.053564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1070/2111] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:48.060038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70613550-6bd2-4836-b522-cda3d86d873a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.069567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70613550-6bd2-4836-b522-cda3d86d873a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.074350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87f76-e296-4a9d-b976-3b658def5361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.074946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87f76-e296-4a9d-b976-3b658def5361 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.075222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87f76-e296-4a9d-b976-3b658def5361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.075489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87f76-e296-4a9d-b976-3b658def5361 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.076128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87f76-e296-4a9d-b976-3b658def5361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:48.076425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87f76-e296-4a9d-b976-3b658def5361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.078307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b87f76-e296-4a9d-b976-3b658def5361 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.089880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1042/2112] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:48.095155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2b7e5-4b9d-48c6-b7af-e81d4f64f861 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.104589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2b7e5-4b9d-48c6-b7af-e81d4f64f861 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.110072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb28fc-fc9a-4f28-963c-4d1abaa87981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.110849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb28fc-fc9a-4f28-963c-4d1abaa87981 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.111130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb28fc-fc9a-4f28-963c-4d1abaa87981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.111402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb28fc-fc9a-4f28-963c-4d1abaa87981 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.112020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb28fc-fc9a-4f28-963c-4d1abaa87981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.114040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb28fc-fc9a-4f28-963c-4d1abaa87981 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.231631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1071/2113] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:48.238147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87f76-e296-4a9d-b976-3b658def5361 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.248238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87f76-e296-4a9d-b976-3b658def5361 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.309451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c844c-b39d-4e85-9958-77027dc1d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.310418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c844c-b39d-4e85-9958-77027dc1d590 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.310711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c844c-b39d-4e85-9958-77027dc1d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.310985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c844c-b39d-4e85-9958-77027dc1d590 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.311634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c844c-b39d-4e85-9958-77027dc1d590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.314407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c844c-b39d-4e85-9958-77027dc1d590 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.451072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1043/2114] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/users => generated 282 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:48.455212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb28fc-fc9a-4f28-963c-4d1abaa87981 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.465429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb28fc-fc9a-4f28-963c-4d1abaa87981 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.469951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277c4d-8e26-43e9-a6f2-a496aec83a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.470545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277c4d-8e26-43e9-a6f2-a496aec83a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.470829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277c4d-8e26-43e9-a6f2-a496aec83a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.471120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277c4d-8e26-43e9-a6f2-a496aec83a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.471755 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74277c4d-8e26-43e9-a6f2-a496aec83a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.473342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74277c4d-8e26-43e9-a6f2-a496aec83a50 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.485193 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1072/2115] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:48.489110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c844c-b39d-4e85-9958-77027dc1d590 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.499042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c844c-b39d-4e85-9958-77027dc1d590 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.504712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37716d47-980c-45dc-bf2f-e4c096fb4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.505307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716d47-980c-45dc-bf2f-e4c096fb4d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.505645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716d47-980c-45dc-bf2f-e4c096fb4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.505914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716d47-980c-45dc-bf2f-e4c096fb4d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.506550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37716d47-980c-45dc-bf2f-e4c096fb4d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.508195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37716d47-980c-45dc-bf2f-e4c096fb4d5a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.519505 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1044/2116] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:48.523656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277c4d-8e26-43e9-a6f2-a496aec83a50 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.534244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277c4d-8e26-43e9-a6f2-a496aec83a50 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.539149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ea8b-ce82-43ec-a409-c3658806c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.539799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ea8b-ce82-43ec-a409-c3658806c192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.540072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ea8b-ce82-43ec-a409-c3658806c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.540340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381ea8b-ce82-43ec-a409-c3658806c192 admin admin] PATH_INFO: `/v3/projects/9eaaacbc70d648bf97c41224db3818bd/users/7cb5f0bf5493467f962b6e6a5556b185/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.556888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381ea8b-ce82-43ec-a409-c3658806c192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eaaacbc70d648bf97c41224db3818bd, user_id=7cb5f0bf5493467f962b6e6a5556b185, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.559652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381ea8b-ce82-43ec-a409-c3658806c192 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.664956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1073/2117] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:48 2022] PUT /identity/v3/projects/9eaaacbc70d648bf97c41224db3818bd/users/7cb5f0bf5493467f962b6e6a5556b185/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:48.676987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512f3c-4af0-4841-8765-670c5bb214f6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.677271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512f3c-4af0-4841-8765-670c5bb214f6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.677578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512f3c-4af0-4841-8765-670c5bb214f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.707307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-47512f3c-4af0-4841-8765-670c5bb214f6 None None] MFA Rules not processed for user `7cb5f0bf5493467f962b6e6a5556b185`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:48.708511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-47512f3c-4af0-4841-8765-670c5bb214f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.775136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1045/2118] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:48.786546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ea8b-ce82-43ec-a409-c3658806c192 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.788381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3381ea8b-ce82-43ec-a409-c3658806c192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.838711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:48.849291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381ea8b-ce82-43ec-a409-c3658806c192 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.852863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58986c42-b252-4517-a01c-5a8a55328939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.853481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986c42-b252-4517-a01c-5a8a55328939 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.853789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986c42-b252-4517-a01c-5a8a55328939 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.854058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986c42-b252-4517-a01c-5a8a55328939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.862744 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58986c42-b252-4517-a01c-5a8a55328939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.864187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58986c42-b252-4517-a01c-5a8a55328939 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.872824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1074/2119] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:49.269576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0f41e-506f-41c1-8ef9-a7256d0e25b5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.270085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0f41e-506f-41c1-8ef9-a7256d0e25b5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.270176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0f41e-506f-41c1-8ef9-a7256d0e25b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.289651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b7c0f41e-506f-41c1-8ef9-a7256d0e25b5 None None] MFA Rules not processed for user `942b805b400042238a94cc1955a7a709`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:49.290976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b7c0f41e-506f-41c1-8ef9-a7256d0e25b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:49.351177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:49.372393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1046/2120] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:53.843689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e3e0-8f3a-4091-84db-70a6971c8185 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:53.844170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e3e0-8f3a-4091-84db-70a6971c8185 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:53.844248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e3e0-8f3a-4091-84db-70a6971c8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:53.865043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4a31e3e0-8f3a-4091-84db-70a6971c8185 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:53.866296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4a31e3e0-8f3a-4091-84db-70a6971c8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:53.926303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1075/2121] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:53.950756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0f41e-506f-41c1-8ef9-a7256d0e25b5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:53.952242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b7c0f41e-506f-41c1-8ef9-a7256d0e25b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:54.037844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0f41e-506f-41c1-8ef9-a7256d0e25b5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:54.044744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e411c-63ad-4106-8822-a252fdcaa574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:54.045446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e411c-63ad-4106-8822-a252fdcaa574 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:54.048196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e411c-63ad-4106-8822-a252fdcaa574 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:54.048196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e411c-63ad-4106-8822-a252fdcaa574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:54.056880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e411c-63ad-4106-8822-a252fdcaa574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:54.058477 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e411c-63ad-4106-8822-a252fdcaa574 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:54.072394 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1047/2122] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:04:57.941878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a350e-d3c2-47ca-bb95-54efb34fe9d0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:57.942363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a350e-d3c2-47ca-bb95-54efb34fe9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:57.942452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a350e-d3c2-47ca-bb95-54efb34fe9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:57.964450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1d4a350e-d3c2-47ca-bb95-54efb34fe9d0 None None] MFA Rules not processed for user `9870363844644da7ad0a353f8ebfeffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:57.964450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1d4a350e-d3c2-47ca-bb95-54efb34fe9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:58.027748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1076/2123] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:04:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:04:58.662306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc081-7edc-4570-8b23-91866a504dd0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:58.662794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc081-7edc-4570-8b23-91866a504dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:58.662926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc081-7edc-4570-8b23-91866a504dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:58.686191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-365cc081-7edc-4570-8b23-91866a504dd0 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:58.687567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-365cc081-7edc-4570-8b23-91866a504dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:58.710750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1048/2124] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:04:58.742428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a350e-d3c2-47ca-bb95-54efb34fe9d0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:58.744051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1d4a350e-d3c2-47ca-bb95-54efb34fe9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:58.764008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a350e-d3c2-47ca-bb95-54efb34fe9d0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:58.772336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d65787-33e4-4156-bd62-f38b2b1ee4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:58.773214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d65787-33e4-4156-bd62-f38b2b1ee4ea service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:58.773580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d65787-33e4-4156-bd62-f38b2b1ee4ea service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:58.773904 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d65787-33e4-4156-bd62-f38b2b1ee4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:58.783901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d65787-33e4-4156-bd62-f38b2b1ee4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:58.785697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d65787-33e4-4156-bd62-f38b2b1ee4ea service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:58.796104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1077/2125] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:05.168389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc081-7edc-4570-8b23-91866a504dd0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:05.170508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-365cc081-7edc-4570-8b23-91866a504dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:05.191141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc081-7edc-4570-8b23-91866a504dd0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:05.197120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:05.198169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.198731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.199218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] PATH_INFO: `/v3/users/e91fee96d1b04d4aa9f647270f5f618f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.221309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91fee96d1b04d4aa9f647270f5f618f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:05.221309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:05.535433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91fee96d1b04d4aa9f647270f5f618f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.544894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91fee96d1b04d4aa9f647270f5f618f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.545663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91fee96d1b04d4aa9f647270f5f618f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.546277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91fee96d1b04d4aa9f647270f5f618f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.652760 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91fee96d1b04d4aa9f647270f5f618f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:05.681068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1049/2126] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:05 2022] DELETE /identity/v3/users/e91fee96d1b04d4aa9f647270f5f618f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:05.685803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112343de-9ff3-4e99-9285-3d261cc8e46e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.691440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112343de-9ff3-4e99-9285-3d261cc8e46e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.691440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112343de-9ff3-4e99-9285-3d261cc8e46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.707641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-112343de-9ff3-4e99-9285-3d261cc8e46e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:05.708930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-112343de-9ff3-4e99-9285-3d261cc8e46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:05.795055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1078/2127] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:05.811003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:05.812773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:05.887435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:05.916864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184019f-4a79-4478-8158-676b3309786e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:05.920907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf735-2a7e-4aef-8ed0-97a913e41bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:05.921672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf735-2a7e-4aef-8ed0-97a913e41bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:05.922011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf735-2a7e-4aef-8ed0-97a913e41bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:05.922392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf735-2a7e-4aef-8ed0-97a913e41bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:05.950646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf735-2a7e-4aef-8ed0-97a913e41bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:05.954908 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf735-2a7e-4aef-8ed0-97a913e41bd1 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:05.982016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1050/2128] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:06.131165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5d236-040e-44b3-8a0b-53d100159d80 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:06.131523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5d236-040e-44b3-8a0b-53d100159d80 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:06.132004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5d236-040e-44b3-8a0b-53d100159d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:06.155929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f6e5d236-040e-44b3-8a0b-53d100159d80 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:06.159547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f6e5d236-040e-44b3-8a0b-53d100159d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:06.166315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1079/2129] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:06.192158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf735-2a7e-4aef-8ed0-97a913e41bd1 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:06.193709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2bfaf735-2a7e-4aef-8ed0-97a913e41bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:06.290599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf735-2a7e-4aef-8ed0-97a913e41bd1 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:06.297258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22d362-2a0e-4dfa-b8a2-367f88ca77bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:06.297258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d362-2a0e-4dfa-b8a2-367f88ca77bf service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:06.297258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d362-2a0e-4dfa-b8a2-367f88ca77bf service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:06.297258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d362-2a0e-4dfa-b8a2-367f88ca77bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:06.306499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22d362-2a0e-4dfa-b8a2-367f88ca77bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:06.308167 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22d362-2a0e-4dfa-b8a2-367f88ca77bf service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:06.319994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1051/2130] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:06.944887 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5d236-040e-44b3-8a0b-53d100159d80 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:06.946879 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f6e5d236-040e-44b3-8a0b-53d100159d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:06.959041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5d236-040e-44b3-8a0b-53d100159d80 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:06.978249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:06.979760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:06.979760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:06.979760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] PATH_INFO: `/v3/projects/027fd809d2d34eed80b93dd7d91dd1d6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:06.980803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=027fd809d2d34eed80b93dd7d91dd1d6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:06.982981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:06.996765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:07.129326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027fd809d2d34eed80b93dd7d91dd1d6', 'request_id': 'req-152eb7ae-c36c-409c-a738-b95d164f5c9a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:07.137286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027fd809d2d34eed80b93dd7d91dd1d6', 'request_id': 'req-152eb7ae-c36c-409c-a738-b95d164f5c9a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:07.147002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027fd809d2d34eed80b93dd7d91dd1d6', 'request_id': 'req-152eb7ae-c36c-409c-a738-b95d164f5c9a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:07.238396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] The token cache is being invalidate because project 027fd809d2d34eed80b93dd7d91dd1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:07.238692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:07.239311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-152eb7ae-c36c-409c-a738-b95d164f5c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:07.240808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1080/2131] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:06 2022] DELETE /identity/v3/projects/027fd809d2d34eed80b93dd7d91dd1d6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:07.245677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55882796-343e-443c-9965-c72bd3ea4089 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:07.246203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55882796-343e-443c-9965-c72bd3ea4089 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:07.246285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55882796-343e-443c-9965-c72bd3ea4089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:07.272791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-55882796-343e-443c-9965-c72bd3ea4089 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:07.274049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-55882796-343e-443c-9965-c72bd3ea4089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:07.344382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1052/2132] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:07.353216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2ef9c-43b5-4057-9b47-63b077ad6c89 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:07.353429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2ef9c-43b5-4057-9b47-63b077ad6c89 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:07.353711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2ef9c-43b5-4057-9b47-63b077ad6c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:07.378396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-93e2ef9c-43b5-4057-9b47-63b077ad6c89 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:07.389578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-93e2ef9c-43b5-4057-9b47-63b077ad6c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:07.389578 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1081/2133] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:07.392615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55882796-343e-443c-9965-c72bd3ea4089 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:07.403017 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55882796-343e-443c-9965-c72bd3ea4089 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:07.409055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af857e0-6a30-4ba7-a330-3fc2215a403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:07.410630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af857e0-6a30-4ba7-a330-3fc2215a403b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:07.411018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af857e0-6a30-4ba7-a330-3fc2215a403b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:07.411343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af857e0-6a30-4ba7-a330-3fc2215a403b admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:07.412154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af857e0-6a30-4ba7-a330-3fc2215a403b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:07.412721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af857e0-6a30-4ba7-a330-3fc2215a403b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:07.415265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af857e0-6a30-4ba7-a330-3fc2215a403b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:07.432358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1053/2134] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:05:07.433554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2ef9c-43b5-4057-9b47-63b077ad6c89 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:07.445749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2ef9c-43b5-4057-9b47-63b077ad6c89 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:07.450386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82210bd5-c3e7-4bb1-b3d0-db88a463d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:07.450988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210bd5-c3e7-4bb1-b3d0-db88a463d473 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:07.451257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210bd5-c3e7-4bb1-b3d0-db88a463d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:07.451523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210bd5-c3e7-4bb1-b3d0-db88a463d473 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:07.452181 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82210bd5-c3e7-4bb1-b3d0-db88a463d473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:07.454123 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82210bd5-c3e7-4bb1-b3d0-db88a463d473 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:07.561117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1082/2135] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:07 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:07.562344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af857e0-6a30-4ba7-a330-3fc2215a403b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:07.575373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af857e0-6a30-4ba7-a330-3fc2215a403b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:07.645061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:07.661050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a58823-df3b-4380-9db8-8948077c4147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:07.661716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58823-df3b-4380-9db8-8948077c4147 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:07.661993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58823-df3b-4380-9db8-8948077c4147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:07.662263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58823-df3b-4380-9db8-8948077c4147 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:07.662921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a58823-df3b-4380-9db8-8948077c4147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:07.664837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a58823-df3b-4380-9db8-8948077c4147 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:07.764795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1054/2136] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:07 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:07.766006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82210bd5-c3e7-4bb1-b3d0-db88a463d473 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:07.777307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82210bd5-c3e7-4bb1-b3d0-db88a463d473 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:07.784870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1e842-af03-472b-9e37-3345e5f08e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:07.785503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1e842-af03-472b-9e37-3345e5f08e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:07.785818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1e842-af03-472b-9e37-3345e5f08e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:07.786138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1e842-af03-472b-9e37-3345e5f08e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:07.786793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1e842-af03-472b-9e37-3345e5f08e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:07.788397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1e842-af03-472b-9e37-3345e5f08e5f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:07.804847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1083/2137] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:07.806310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a58823-df3b-4380-9db8-8948077c4147 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:07.817863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a58823-df3b-4380-9db8-8948077c4147 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:07.822894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3556fc1-06e4-449c-a89e-035e9b42ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:07.823499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3556fc1-06e4-449c-a89e-035e9b42ed31 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:07.823991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3556fc1-06e4-449c-a89e-035e9b42ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:07.824270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3556fc1-06e4-449c-a89e-035e9b42ed31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:07.824907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3556fc1-06e4-449c-a89e-035e9b42ed31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:07.826704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3556fc1-06e4-449c-a89e-035e9b42ed31 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:07.840646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1055/2138] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:07.844814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1e842-af03-472b-9e37-3345e5f08e5f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:07.857558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1e842-af03-472b-9e37-3345e5f08e5f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:07.864570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8a33d-7c90-4e32-bad5-4d0e43ee1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:07.864570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a33d-7c90-4e32-bad5-4d0e43ee1a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:07.864964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a33d-7c90-4e32-bad5-4d0e43ee1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:07.865091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a33d-7c90-4e32-bad5-4d0e43ee1a16 admin admin] PATH_INFO: `/v3/projects/38c558aee85d418e9afe52ca54849241/users/bc97870c4033408c9533cf92a9aa4845/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:07.884643 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8a33d-7c90-4e32-bad5-4d0e43ee1a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c558aee85d418e9afe52ca54849241, user_id=bc97870c4033408c9533cf92a9aa4845, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:07.887366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8a33d-7c90-4e32-bad5-4d0e43ee1a16 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:07.950540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1084/2139] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:07 2022] PUT /identity/v3/projects/38c558aee85d418e9afe52ca54849241/users/bc97870c4033408c9533cf92a9aa4845/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:07.961959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302b8cc-0f0b-41ca-bafd-1039a303a0eb None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:07.962238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302b8cc-0f0b-41ca-bafd-1039a303a0eb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:07.962508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302b8cc-0f0b-41ca-bafd-1039a303a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:07.991666 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4302b8cc-0f0b-41ca-bafd-1039a303a0eb None None] MFA Rules not processed for user `bc97870c4033408c9533cf92a9aa4845`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:07.992867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4302b8cc-0f0b-41ca-bafd-1039a303a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:08.077433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1056/2140] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:08.091356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8a33d-7c90-4e32-bad5-4d0e43ee1a16 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:08.093155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b2e8a33d-7c90-4e32-bad5-4d0e43ee1a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:08.181847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8a33d-7c90-4e32-bad5-4d0e43ee1a16 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:08.185987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e398dc-c0a3-4425-8faf-28277fc3bc88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:08.186699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e398dc-c0a3-4425-8faf-28277fc3bc88 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:08.187040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e398dc-c0a3-4425-8faf-28277fc3bc88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:08.187370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e398dc-c0a3-4425-8faf-28277fc3bc88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:08.197111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e398dc-c0a3-4425-8faf-28277fc3bc88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:08.198666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e398dc-c0a3-4425-8faf-28277fc3bc88 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:08.209730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1085/2141] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:08.234479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302b8cc-0f0b-41ca-bafd-1039a303a0eb None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:08.301627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302b8cc-0f0b-41ca-bafd-1039a303a0eb None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:08.309742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:08.309742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:08.309742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:08.309742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] PATH_INFO: `/v3/users/bc97870c4033408c9533cf92a9aa4845` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:08.315050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc97870c4033408c9533cf92a9aa4845)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:08.326918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:08.575125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc97870c4033408c9533cf92a9aa4845'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:08.582454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc97870c4033408c9533cf92a9aa4845'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:08.583211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc97870c4033408c9533cf92a9aa4845'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:08.583832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc97870c4033408c9533cf92a9aa4845'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:08.664394 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc97870c4033408c9533cf92a9aa4845'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:08.665811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:08.683665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1057/2142] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:08 2022] DELETE /identity/v3/users/bc97870c4033408c9533cf92a9aa4845 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:08.688134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb9467-6183-4b82-8b60-6f3ac4b3457f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:08.688421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb9467-6183-4b82-8b60-6f3ac4b3457f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:08.688693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb9467-6183-4b82-8b60-6f3ac4b3457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:08.708777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-61bb9467-6183-4b82-8b60-6f3ac4b3457f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:08.710012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-61bb9467-6183-4b82-8b60-6f3ac4b3457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:08.746937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:08.784030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1086/2143] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:08.794036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:08.795527 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:08.857311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b9f3-05bd-4b66-9ab8-c361c0ac170d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:08.860900 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705291d-2226-44ad-86d8-308cd386e5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:08.861685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705291d-2226-44ad-86d8-308cd386e5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:08.861888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705291d-2226-44ad-86d8-308cd386e5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:08.862125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705291d-2226-44ad-86d8-308cd386e5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:08.875502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705291d-2226-44ad-86d8-308cd386e5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:08.877650 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705291d-2226-44ad-86d8-308cd386e5d3 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:08.888049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1058/2144] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:09.334971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb9467-6183-4b82-8b60-6f3ac4b3457f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:09.336469 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-61bb9467-6183-4b82-8b60-6f3ac4b3457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:09.353516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb9467-6183-4b82-8b60-6f3ac4b3457f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:09.360233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:09.361029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:09.362954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:09.363352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] PATH_INFO: `/v3/projects/38c558aee85d418e9afe52ca54849241` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:09.364638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c558aee85d418e9afe52ca54849241)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:09.369747 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:09.490664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c558aee85d418e9afe52ca54849241', 'request_id': 'req-4f9a9e98-53c0-4371-95a0-954b637772f7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:09.496949 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c558aee85d418e9afe52ca54849241', 'request_id': 'req-4f9a9e98-53c0-4371-95a0-954b637772f7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:09.506806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c558aee85d418e9afe52ca54849241', 'request_id': 'req-4f9a9e98-53c0-4371-95a0-954b637772f7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:09.599694 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] The token cache is being invalidate because project 38c558aee85d418e9afe52ca54849241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:09.600326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:09.601403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4f9a9e98-53c0-4371-95a0-954b637772f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:09.603646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1087/2145] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:09 2022] DELETE /identity/v3/projects/38c558aee85d418e9afe52ca54849241 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:09.608592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337ac93-8377-46a7-9ffb-feaaa6777448 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:09.609021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337ac93-8377-46a7-9ffb-feaaa6777448 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:09.609142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337ac93-8377-46a7-9ffb-feaaa6777448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:09.638828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1337ac93-8377-46a7-9ffb-feaaa6777448 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:09.641228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1337ac93-8377-46a7-9ffb-feaaa6777448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:09.740897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1059/2146] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:09.756703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d49ca-2d64-4ba4-a737-7f2a7121f7ee None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:09.756703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d49ca-2d64-4ba4-a737-7f2a7121f7ee None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:09.756703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d49ca-2d64-4ba4-a737-7f2a7121f7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:09.775627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b04d49ca-2d64-4ba4-a737-7f2a7121f7ee None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:09.776811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b04d49ca-2d64-4ba4-a737-7f2a7121f7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:09.785159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1088/2147] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:09.789398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337ac93-8377-46a7-9ffb-feaaa6777448 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:09.799433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337ac93-8377-46a7-9ffb-feaaa6777448 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:09.804039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ddfc6-2b0f-4b03-b1f4-205db4960fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:09.804631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ddfc6-2b0f-4b03-b1f4-205db4960fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:09.804908 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ddfc6-2b0f-4b03-b1f4-205db4960fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:09.805176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ddfc6-2b0f-4b03-b1f4-205db4960fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:09.805872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ddfc6-2b0f-4b03-b1f4-205db4960fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:09.806166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ddfc6-2b0f-4b03-b1f4-205db4960fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:09.807752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ddfc6-2b0f-4b03-b1f4-205db4960fcf admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:09.819727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1060/2148] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:05:09.823847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d49ca-2d64-4ba4-a737-7f2a7121f7ee None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:09.833685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d49ca-2d64-4ba4-a737-7f2a7121f7ee None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:09.838320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57dbf8-ae3c-4bd0-916a-3c63cb2db151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:09.838913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57dbf8-ae3c-4bd0-916a-3c63cb2db151 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:09.839192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57dbf8-ae3c-4bd0-916a-3c63cb2db151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:09.839489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57dbf8-ae3c-4bd0-916a-3c63cb2db151 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:09.840120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57dbf8-ae3c-4bd0-916a-3c63cb2db151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:09.842064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57dbf8-ae3c-4bd0-916a-3c63cb2db151 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:09.944411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1089/2149] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:09 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:09.947955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ddfc6-2b0f-4b03-b1f4-205db4960fcf admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:09.958464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ddfc6-2b0f-4b03-b1f4-205db4960fcf admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:10.024961 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2cf91-020b-4558-a5af-1345c0daa71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:10.025453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2cf91-020b-4558-a5af-1345c0daa71a admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:10.025769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2cf91-020b-4558-a5af-1345c0daa71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:10.026041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2cf91-020b-4558-a5af-1345c0daa71a admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:10.026710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2cf91-020b-4558-a5af-1345c0daa71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:10.028711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2cf91-020b-4558-a5af-1345c0daa71a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:10.105740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:10.111080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1061/2150] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:09 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:10.115651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57dbf8-ae3c-4bd0-916a-3c63cb2db151 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:10.126455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57dbf8-ae3c-4bd0-916a-3c63cb2db151 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:10.131518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e07250-98a6-400e-9c20-8eb6ea8caab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:10.132124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e07250-98a6-400e-9c20-8eb6ea8caab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:10.132405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e07250-98a6-400e-9c20-8eb6ea8caab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:10.132678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e07250-98a6-400e-9c20-8eb6ea8caab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:10.133323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e07250-98a6-400e-9c20-8eb6ea8caab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:10.134961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e07250-98a6-400e-9c20-8eb6ea8caab1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:10.146102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1090/2151] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:10.150210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2cf91-020b-4558-a5af-1345c0daa71a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:10.161076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2cf91-020b-4558-a5af-1345c0daa71a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:10.165726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b4ca0-b203-4187-ad3f-9e5423e7fa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:10.166323 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b4ca0-b203-4187-ad3f-9e5423e7fa02 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:10.166603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b4ca0-b203-4187-ad3f-9e5423e7fa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:10.166874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b4ca0-b203-4187-ad3f-9e5423e7fa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:10.167517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b4ca0-b203-4187-ad3f-9e5423e7fa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:10.169101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b4ca0-b203-4187-ad3f-9e5423e7fa02 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:10.179933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1062/2152] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:10.184208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e07250-98a6-400e-9c20-8eb6ea8caab1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:10.197974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e07250-98a6-400e-9c20-8eb6ea8caab1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:10.203028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0668-2642-4f17-a57c-1f19106af53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:10.203698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0668-2642-4f17-a57c-1f19106af53c admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:10.203974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0668-2642-4f17-a57c-1f19106af53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:10.204248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0668-2642-4f17-a57c-1f19106af53c admin admin] PATH_INFO: `/v3/projects/8e829fd5b88244728d2a620f2f013344/users/2809fbe184c04a8591580c630b483fa0/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:10.221918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d0668-2642-4f17-a57c-1f19106af53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e829fd5b88244728d2a620f2f013344, user_id=2809fbe184c04a8591580c630b483fa0, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:10.227770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d0668-2642-4f17-a57c-1f19106af53c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:10.356675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1091/2153] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:10 2022] PUT /identity/v3/projects/8e829fd5b88244728d2a620f2f013344/users/2809fbe184c04a8591580c630b483fa0/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:10.367520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117bc98-4000-4361-b28a-f7146e0583ec None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:10.367793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117bc98-4000-4361-b28a-f7146e0583ec None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:10.368063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117bc98-4000-4361-b28a-f7146e0583ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:10.396720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6117bc98-4000-4361-b28a-f7146e0583ec None None] MFA Rules not processed for user `2809fbe184c04a8591580c630b483fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:10.398023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6117bc98-4000-4361-b28a-f7146e0583ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:10.481525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1063/2154] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:10.485745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0668-2642-4f17-a57c-1f19106af53c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:10.488067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a68d0668-2642-4f17-a57c-1f19106af53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:10.560584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0668-2642-4f17-a57c-1f19106af53c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:10.564887 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7e18a-ffe5-4fb7-96b8-6aaebb1a4edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:10.566212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7e18a-ffe5-4fb7-96b8-6aaebb1a4edd service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:10.566495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7e18a-ffe5-4fb7-96b8-6aaebb1a4edd service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:10.566888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7e18a-ffe5-4fb7-96b8-6aaebb1a4edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:10.575599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7e18a-ffe5-4fb7-96b8-6aaebb1a4edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:10.576965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7e18a-ffe5-4fb7-96b8-6aaebb1a4edd service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:10.581870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:10.588003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1092/2155] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:12.647897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec6090-f3fb-42a2-ac51-acdde4d553d5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:12.648456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec6090-f3fb-42a2-ac51-acdde4d553d5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:12.648456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec6090-f3fb-42a2-ac51-acdde4d553d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:12.670723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c7ec6090-f3fb-42a2-ac51-acdde4d553d5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:12.671957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c7ec6090-f3fb-42a2-ac51-acdde4d553d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:12.746057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1064/2156] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:12.793322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7e18a-ffe5-4fb7-96b8-6aaebb1a4edd service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:12.795053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-aad7e18a-ffe5-4fb7-96b8-6aaebb1a4edd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:12.907177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7e18a-ffe5-4fb7-96b8-6aaebb1a4edd service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:12.919051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524f56f-4fdd-48e3-b7ae-f8c3abc8146e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:12.919051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524f56f-4fdd-48e3-b7ae-f8c3abc8146e service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:12.919051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524f56f-4fdd-48e3-b7ae-f8c3abc8146e service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:12.919051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524f56f-4fdd-48e3-b7ae-f8c3abc8146e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:12.931601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524f56f-4fdd-48e3-b7ae-f8c3abc8146e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:12.933413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524f56f-4fdd-48e3-b7ae-f8c3abc8146e service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:12.951284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1093/2157] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:13.351562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d4b30-e62d-4afb-b4d8-683252854694 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:13.351986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d4b30-e62d-4afb-b4d8-683252854694 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:13.352264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d4b30-e62d-4afb-b4d8-683252854694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:13.372823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b49d4b30-e62d-4afb-b4d8-683252854694 None None] MFA Rules not processed for user `af1baafb29de4485b4712a29fdfaf9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:13.374109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b49d4b30-e62d-4afb-b4d8-683252854694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:13.461516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1065/2158] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:22.609878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29534b2e-c8b9-474c-b5e7-8071ce3f0849 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:22.611515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29534b2e-c8b9-474c-b5e7-8071ce3f0849 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:22.612106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29534b2e-c8b9-474c-b5e7-8071ce3f0849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:22.639234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-29534b2e-c8b9-474c-b5e7-8071ce3f0849 None None] MFA Rules not processed for user `942b805b400042238a94cc1955a7a709`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:22.640292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-29534b2e-c8b9-474c-b5e7-8071ce3f0849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:22.729297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1094/2159] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:23.452616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:23.627914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d4b30-e62d-4afb-b4d8-683252854694 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:23.640403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d4b30-e62d-4afb-b4d8-683252854694 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:23.646367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:23.647032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:23.647384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:23.647927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] PATH_INFO: `/v3/users/2809fbe184c04a8591580c630b483fa0` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:23.649130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2809fbe184c04a8591580c630b483fa0)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:23.651101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:23.892712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2809fbe184c04a8591580c630b483fa0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:23.900691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2809fbe184c04a8591580c630b483fa0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:23.901405 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2809fbe184c04a8591580c630b483fa0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:23.902052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2809fbe184c04a8591580c630b483fa0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:24.010036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2809fbe184c04a8591580c630b483fa0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:24.052679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1066/2160] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:23 2022] DELETE /identity/v3/users/2809fbe184c04a8591580c630b483fa0 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:24.064971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b5a6-c37e-49c6-be05-3679698bf633 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:24.064971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b5a6-c37e-49c6-be05-3679698bf633 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:24.064971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b5a6-c37e-49c6-be05-3679698bf633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:24.083344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e038b5a6-c37e-49c6-be05-3679698bf633 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:24.084548 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e038b5a6-c37e-49c6-be05-3679698bf633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:24.214568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1095/2161] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:24.224375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:24.225896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:24.323941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425eedc-d916-4b37-b77c-7cd581bf17ff admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:24.328559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4835e-da6b-460a-800c-9d905491b1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:24.329216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4835e-da6b-460a-800c-9d905491b1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:24.329793 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4835e-da6b-460a-800c-9d905491b1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:24.330518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4835e-da6b-460a-800c-9d905491b1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:24.358405 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4835e-da6b-460a-800c-9d905491b1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:24.364452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4835e-da6b-460a-800c-9d905491b1c8 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:24.372476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1067/2162] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:24.859966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038b5a6-c37e-49c6-be05-3679698bf633 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:24.862162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e038b5a6-c37e-49c6-be05-3679698bf633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:24.878170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038b5a6-c37e-49c6-be05-3679698bf633 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:24.883539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:24.885141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:24.885519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:24.885794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] PATH_INFO: `/v3/projects/8e829fd5b88244728d2a620f2f013344` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:24.887341 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e829fd5b88244728d2a620f2f013344)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:24.889290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:24.916153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:25.036874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e829fd5b88244728d2a620f2f013344', 'request_id': 'req-0edb6edd-37c6-451d-b128-175491b80c90'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:25.042381 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e829fd5b88244728d2a620f2f013344', 'request_id': 'req-0edb6edd-37c6-451d-b128-175491b80c90'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:25.048590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e829fd5b88244728d2a620f2f013344', 'request_id': 'req-0edb6edd-37c6-451d-b128-175491b80c90'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:25.135236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] The token cache is being invalidate because project 8e829fd5b88244728d2a620f2f013344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:25.135939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:25.136303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0edb6edd-37c6-451d-b128-175491b80c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:25.137883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1096/2163] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:24 2022] DELETE /identity/v3/projects/8e829fd5b88244728d2a620f2f013344 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:25.143692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97363bb-a7b0-4b55-b578-a51b426608f1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:25.144200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97363bb-a7b0-4b55-b578-a51b426608f1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:25.144397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97363bb-a7b0-4b55-b578-a51b426608f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:25.172944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a97363bb-a7b0-4b55-b578-a51b426608f1 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:25.172944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a97363bb-a7b0-4b55-b578-a51b426608f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:25.240407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1068/2164] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:05:25.248751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a712-a785-4087-95a4-aed6edeeef65 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:25.249740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a712-a785-4087-95a4-aed6edeeef65 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:25.250043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a712-a785-4087-95a4-aed6edeeef65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:25.271555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a9a1a712-a785-4087-95a4-aed6edeeef65 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:25.272941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a9a1a712-a785-4087-95a4-aed6edeeef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:25.281037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1097/2165] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:25.285915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97363bb-a7b0-4b55-b578-a51b426608f1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:25.296537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97363bb-a7b0-4b55-b578-a51b426608f1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:25.301874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39400dac-e6d2-4ae6-8822-224f515f5d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:25.302476 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39400dac-e6d2-4ae6-8822-224f515f5d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:25.302754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39400dac-e6d2-4ae6-8822-224f515f5d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:25.303026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39400dac-e6d2-4ae6-8822-224f515f5d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:25.303675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39400dac-e6d2-4ae6-8822-224f515f5d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:05:25.303980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39400dac-e6d2-4ae6-8822-224f515f5d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:25.305600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39400dac-e6d2-4ae6-8822-224f515f5d15 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:25.317810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1069/2166] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:05:25.321950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1a712-a785-4087-95a4-aed6edeeef65 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:25.331782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1a712-a785-4087-95a4-aed6edeeef65 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:25.336299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd9663-5e2a-4fdc-ab98-66abc9e112fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:25.336882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd9663-5e2a-4fdc-ab98-66abc9e112fe admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:25.337154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd9663-5e2a-4fdc-ab98-66abc9e112fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:25.337417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd9663-5e2a-4fdc-ab98-66abc9e112fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:25.338057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd9663-5e2a-4fdc-ab98-66abc9e112fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:25.339966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd9663-5e2a-4fdc-ab98-66abc9e112fe admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:25.446717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1098/2167] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:25 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:05:25.450869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39400dac-e6d2-4ae6-8822-224f515f5d15 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:25.457124 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:25.462356 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39400dac-e6d2-4ae6-8822-224f515f5d15 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:25.528970 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d22a62-f94f-4bcc-bcc8-b4b964d81c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:25.529883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d22a62-f94f-4bcc-bcc8-b4b964d81c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:25.530160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d22a62-f94f-4bcc-bcc8-b4b964d81c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:25.530430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d22a62-f94f-4bcc-bcc8-b4b964d81c5a admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:25.531067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d22a62-f94f-4bcc-bcc8-b4b964d81c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:25.533890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d22a62-f94f-4bcc-bcc8-b4b964d81c5a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:25.634522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1070/2168] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:25 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:25.638167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd9663-5e2a-4fdc-ab98-66abc9e112fe admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:25.649587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd9663-5e2a-4fdc-ab98-66abc9e112fe admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:25.654198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc73e0-ef96-481c-8fdc-dd2764eba37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:25.654797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc73e0-ef96-481c-8fdc-dd2764eba37f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:25.655074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc73e0-ef96-481c-8fdc-dd2764eba37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:25.655341 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc73e0-ef96-481c-8fdc-dd2764eba37f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:25.655984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc73e0-ef96-481c-8fdc-dd2764eba37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:25.657763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc73e0-ef96-481c-8fdc-dd2764eba37f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:25.668365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1099/2169] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:05:25.672268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d22a62-f94f-4bcc-bcc8-b4b964d81c5a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:25.683499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d22a62-f94f-4bcc-bcc8-b4b964d81c5a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:25.688576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254607db-ff92-4ce4-b5d1-aacb5ce4d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:25.689834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254607db-ff92-4ce4-b5d1-aacb5ce4d4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:25.690188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254607db-ff92-4ce4-b5d1-aacb5ce4d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:25.690465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254607db-ff92-4ce4-b5d1-aacb5ce4d4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:25.691099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254607db-ff92-4ce4-b5d1-aacb5ce4d4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:25.692664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254607db-ff92-4ce4-b5d1-aacb5ce4d4c6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:25.707160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc73e0-ef96-481c-8fdc-dd2764eba37f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:25.712280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1071/2170] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:05:25.717704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc73e0-ef96-481c-8fdc-dd2764eba37f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:25.725971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9ed8-5f2e-4888-bd32-ac13da558f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:25.726629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9ed8-5f2e-4888-bd32-ac13da558f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:25.726905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9ed8-5f2e-4888-bd32-ac13da558f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:25.727356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9ed8-5f2e-4888-bd32-ac13da558f79 admin admin] PATH_INFO: `/v3/projects/7c816f79bcff4072b904f6e351a828de/users/deee2d42d2284c69aca96cbbef51650d/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:25.743477 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc9ed8-5f2e-4888-bd32-ac13da558f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c816f79bcff4072b904f6e351a828de, user_id=deee2d42d2284c69aca96cbbef51650d, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:25.746173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc9ed8-5f2e-4888-bd32-ac13da558f79 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:25.843396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1100/2171] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:25 2022] PUT /identity/v3/projects/7c816f79bcff4072b904f6e351a828de/users/deee2d42d2284c69aca96cbbef51650d/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:25.849159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9147-ee5c-43ed-84d2-3c3a4e90a19d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:25.849441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9147-ee5c-43ed-84d2-3c3a4e90a19d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:25.849738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9147-ee5c-43ed-84d2-3c3a4e90a19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:25.869901 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dbfc9147-ee5c-43ed-84d2-3c3a4e90a19d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:25.871119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dbfc9147-ee5c-43ed-84d2-3c3a4e90a19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:25.930605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1072/2172] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:25.940106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9ed8-5f2e-4888-bd32-ac13da558f79 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:25.941840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9adc9ed8-5f2e-4888-bd32-ac13da558f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:25.997101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9ed8-5f2e-4888-bd32-ac13da558f79 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:26.001319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cbee5-6738-4f73-821b-2fcef165907a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:26.002126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cbee5-6738-4f73-821b-2fcef165907a service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:26.005670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cbee5-6738-4f73-821b-2fcef165907a service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:26.005670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cbee5-6738-4f73-821b-2fcef165907a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:26.011775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cbee5-6738-4f73-821b-2fcef165907a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:26.013201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cbee5-6738-4f73-821b-2fcef165907a service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:26.024546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1101/2173] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:05:30.790661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce150-c9d8-468a-97a7-89c94d30e833 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:30.791162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce150-c9d8-468a-97a7-89c94d30e833 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:30.791242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce150-c9d8-468a-97a7-89c94d30e833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:30.812160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b96ce150-c9d8-468a-97a7-89c94d30e833 None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:30.813367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b96ce150-c9d8-468a-97a7-89c94d30e833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:30.898117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1073/2174] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:05:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:30.966129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cbee5-6738-4f73-821b-2fcef165907a service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:30.966129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-868cbee5-6738-4f73-821b-2fcef165907a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:31.054783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:31.077833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cbee5-6738-4f73-821b-2fcef165907a service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:31.083420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17f779-e4a5-4b99-9018-922c2a1e16eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:31.084058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f779-e4a5-4b99-9018-922c2a1e16eb service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:31.084344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f779-e4a5-4b99-9018-922c2a1e16eb service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:31.084641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f779-e4a5-4b99-9018-922c2a1e16eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:31.093402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17f779-e4a5-4b99-9018-922c2a1e16eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:31.095229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17f779-e4a5-4b99-9018-922c2a1e16eb service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:31.104099 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1102/2175] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:05:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:05:34.114862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce150-c9d8-468a-97a7-89c94d30e833 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.117444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b96ce150-c9d8-468a-97a7-89c94d30e833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:34.143589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce150-c9d8-468a-97a7-89c94d30e833 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:34.154020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:34.155371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.155866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.156451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] PATH_INFO: `/v3/users/7cb5f0bf5493467f962b6e6a5556b185` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.158669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb5f0bf5493467f962b6e6a5556b185)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:34.176742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:34.249101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:34.459724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb5f0bf5493467f962b6e6a5556b185'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.474928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb5f0bf5493467f962b6e6a5556b185'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.475854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb5f0bf5493467f962b6e6a5556b185'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.476625 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb5f0bf5493467f962b6e6a5556b185'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.579618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb5f0bf5493467f962b6e6a5556b185'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:34.681517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1074/2176] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:05:34 2022] DELETE /identity/v3/users/7cb5f0bf5493467f962b6e6a5556b185 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:34.683735 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9d9d-1018-45fc-9ced-316d3df5f7ef None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:34.684265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9d9d-1018-45fc-9ced-316d3df5f7ef None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:34.684265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d9d9d-1018-45fc-9ced-316d3df5f7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:34.723375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ac4d9d9d-1018-45fc-9ced-316d3df5f7ef None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:34.738157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ac4d9d9d-1018-45fc-9ced-316d3df5f7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:34.879109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1103/2177] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:34.948534 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:34.949991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:35.106384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4941c3-86c6-4545-bcf4-fe8c814701a5 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:35.112260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c13cb-f078-4f4b-abea-8431f3de10d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:35.113511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c13cb-f078-4f4b-abea-8431f3de10d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:35.113812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c13cb-f078-4f4b-abea-8431f3de10d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:35.114236 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c13cb-f078-4f4b-abea-8431f3de10d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:35.130415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c13cb-f078-4f4b-abea-8431f3de10d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:35.132059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c13cb-f078-4f4b-abea-8431f3de10d1 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:35.144247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1075/2178] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:37.420518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2d2c9-deb2-4056-babb-89fec4322413 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:37.425104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2d2c9-deb2-4056-babb-89fec4322413 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:37.425104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2d2c9-deb2-4056-babb-89fec4322413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:37.451630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9bc2d2c9-deb2-4056-babb-89fec4322413 None None] MFA Rules not processed for user `deee2d42d2284c69aca96cbbef51650d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:37.453096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9bc2d2c9-deb2-4056-babb-89fec4322413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:37.514973 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c13cb-f078-4f4b-abea-8431f3de10d1 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:37.519010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2f8c13cb-f078-4f4b-abea-8431f3de10d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:37.545687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c13cb-f078-4f4b-abea-8431f3de10d1 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:37.552935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:37.554208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:37.554724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:37.555206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] PATH_INFO: `/v3/projects/9eaaacbc70d648bf97c41224db3818bd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:37.557988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eaaacbc70d648bf97c41224db3818bd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:37.560273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:37.652371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1104/2179] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:37.656891 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2d2c9-deb2-4056-babb-89fec4322413 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:37.659440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9bc2d2c9-deb2-4056-babb-89fec4322413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:37.684471 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2d2c9-deb2-4056-babb-89fec4322413 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:37.697490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003286c-3b71-486b-810e-e9311d917b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:37.705711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003286c-3b71-486b-810e-e9311d917b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:37.705711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003286c-3b71-486b-810e-e9311d917b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:37.705711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003286c-3b71-486b-810e-e9311d917b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:37.705711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003286c-3b71-486b-810e-e9311d917b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:37.705711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003286c-3b71-486b-810e-e9311d917b37 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:37.767750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eaaacbc70d648bf97c41224db3818bd', 'request_id': 'req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.779257 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eaaacbc70d648bf97c41224db3818bd', 'request_id': 'req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.786915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eaaacbc70d648bf97c41224db3818bd', 'request_id': 'req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.939884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1105/2180] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:05:37 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:37.946659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003286c-3b71-486b-810e-e9311d917b37 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:37.982688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] The token cache is being invalidate because project 9eaaacbc70d648bf97c41224db3818bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:05:37.983080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.983887 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:05:37.998034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1076/2181] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:05:37 2022] DELETE /identity/v3/projects/9eaaacbc70d648bf97c41224db3818bd => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:38.096710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:38.119287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003286c-3b71-486b-810e-e9311d917b37 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.131421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf61cf4-dc00-4ab2-8eff-2357296225b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.132468 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61cf4-dc00-4ab2-8eff-2357296225b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.133092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61cf4-dc00-4ab2-8eff-2357296225b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.133629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf61cf4-dc00-4ab2-8eff-2357296225b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.134498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf61cf4-dc00-4ab2-8eff-2357296225b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.136743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf61cf4-dc00-4ab2-8eff-2357296225b9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.278656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1106/2182] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:05:37 2022] POST /identity/v3/users => generated 299 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:05:38.283262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.286801 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:38.381035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:38.459319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcbcce-d977-4390-8ef5-7a5d5aa1fb4f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.474893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a96225-0475-4bbf-85e6-449927d086cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.475864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a96225-0475-4bbf-85e6-449927d086cc admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.476519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a96225-0475-4bbf-85e6-449927d086cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.476952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a96225-0475-4bbf-85e6-449927d086cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.478577 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a96225-0475-4bbf-85e6-449927d086cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.480853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a96225-0475-4bbf-85e6-449927d086cc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.493652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1077/2183] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:38.497612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf61cf4-dc00-4ab2-8eff-2357296225b9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.515141 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf61cf4-dc00-4ab2-8eff-2357296225b9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.527582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57832244-5231-4cec-8126-e247b8cb4c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.528449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57832244-5231-4cec-8126-e247b8cb4c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.529487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57832244-5231-4cec-8126-e247b8cb4c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.530023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57832244-5231-4cec-8126-e247b8cb4c9c admin admin] PATH_INFO: `/v3/projects/abe3d60ea8d64ccfb9bfd65d01f55440/users/476b2b5bfd4d4270a21bb9fcdb89e921/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.559804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57832244-5231-4cec-8126-e247b8cb4c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe3d60ea8d64ccfb9bfd65d01f55440, user_id=476b2b5bfd4d4270a21bb9fcdb89e921, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.562662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57832244-5231-4cec-8126-e247b8cb4c9c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.644166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1107/2184] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:38 2022] PUT /identity/v3/projects/abe3d60ea8d64ccfb9bfd65d01f55440/users/476b2b5bfd4d4270a21bb9fcdb89e921/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:05:38.648197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a96225-0475-4bbf-85e6-449927d086cc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.664654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a96225-0475-4bbf-85e6-449927d086cc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.762971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a83275-8e59-4cb9-9013-26ebac532827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.763642 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a83275-8e59-4cb9-9013-26ebac532827 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.763978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a83275-8e59-4cb9-9013-26ebac532827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.764308 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a83275-8e59-4cb9-9013-26ebac532827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.764901 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a83275-8e59-4cb9-9013-26ebac532827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.767200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a83275-8e59-4cb9-9013-26ebac532827 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.779119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1078/2185] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:05:38.787116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57832244-5231-4cec-8126-e247b8cb4c9c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:38.799539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57832244-5231-4cec-8126-e247b8cb4c9c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:38.806573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89747f8-1451-4fee-a007-32f46449955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:38.807328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89747f8-1451-4fee-a007-32f46449955b admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:38.807671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89747f8-1451-4fee-a007-32f46449955b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:38.808007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89747f8-1451-4fee-a007-32f46449955b admin admin] PATH_INFO: `/v3/projects/abe3d60ea8d64ccfb9bfd65d01f55440/users/476b2b5bfd4d4270a21bb9fcdb89e921/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:38.814348 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89747f8-1451-4fee-a007-32f46449955b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe3d60ea8d64ccfb9bfd65d01f55440, user_id=476b2b5bfd4d4270a21bb9fcdb89e921, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:38.821775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89747f8-1451-4fee-a007-32f46449955b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:38.837562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1108/2186] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:05:38 2022] PUT /identity/v3/projects/abe3d60ea8d64ccfb9bfd65d01f55440/users/476b2b5bfd4d4270a21bb9fcdb89e921/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:05:42.378206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde69c-0639-4e5a-9f7c-35f08c8f9ef9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:42.379397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde69c-0639-4e5a-9f7c-35f08c8f9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:42.379827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde69c-0639-4e5a-9f7c-35f08c8f9ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:42.423485 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-bedde69c-0639-4e5a-9f7c-35f08c8f9ef9 None None] MFA Rules not processed for user `126fe664eb114224b70f8ae9732fcd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:42.428564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bedde69c-0639-4e5a-9f7c-35f08c8f9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:42.598755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1079/2187] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:48.786338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0943-e0bc-427f-8c05-76379f654f5f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:48.786913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0943-e0bc-427f-8c05-76379f654f5f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:48.786913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0943-e0bc-427f-8c05-76379f654f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:48.862497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-590d0943-e0bc-427f-8c05-76379f654f5f None None] MFA Rules not processed for user `476b2b5bfd4d4270a21bb9fcdb89e921`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:48.862497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-590d0943-e0bc-427f-8c05-76379f654f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:48.950604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1109/2188] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:05:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:48.951811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde69c-0639-4e5a-9f7c-35f08c8f9ef9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:48.953451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bedde69c-0639-4e5a-9f7c-35f08c8f9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:49.108206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde69c-0639-4e5a-9f7c-35f08c8f9ef9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:49.114360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79bb81300cff46b7ba1680eedf2762cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:49.114646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:49.114756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:49.115068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:49.117006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:49.136508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:05:49.252368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:49.252368 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:49.276775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1080/2189] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:05:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:05:50.223806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52143c5e-fca5-4876-8c14-e0f1064fbc9f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:50.231981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52143c5e-fca5-4876-8c14-e0f1064fbc9f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:50.231981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52143c5e-fca5-4876-8c14-e0f1064fbc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:50.245866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-52143c5e-fca5-4876-8c14-e0f1064fbc9f None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:05:50.247358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-52143c5e-fca5-4876-8c14-e0f1064fbc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:50.310854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1110/2190] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:05:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:05:50.324908 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:05:50.326342 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:05:50.419340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730df9d3-6a40-44b3-8774-e6e1367a162a service glance] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:05:50.427491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702cd6a-5d84-40e0-9f8d-5448bc60fece service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:05:50.428848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702cd6a-5d84-40e0-9f8d-5448bc60fece service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:05:50.429405 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702cd6a-5d84-40e0-9f8d-5448bc60fece service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:05:50.429930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702cd6a-5d84-40e0-9f8d-5448bc60fece service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:05:50.442265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702cd6a-5d84-40e0-9f8d-5448bc60fece service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:05:50.444279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702cd6a-5d84-40e0-9f8d-5448bc60fece service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:05:50.464185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1081/2191] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:05:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:06:00.303493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:00.455391 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=52 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:00.860853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52143c5e-fca5-4876-8c14-e0f1064fbc9f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:00.862419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-52143c5e-fca5-4876-8c14-e0f1064fbc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:00.921309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702cd6a-5d84-40e0-9f8d-5448bc60fece service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:00.923830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1702cd6a-5d84-40e0-9f8d-5448bc60fece service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:01.011399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52143c5e-fca5-4876-8c14-e0f1064fbc9f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:01.018921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef907a-12ac-4736-bbcc-750bb9dc4e5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:01.024713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef907a-12ac-4736-bbcc-750bb9dc4e5b service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:01.024713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef907a-12ac-4736-bbcc-750bb9dc4e5b service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:01.024713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef907a-12ac-4736-bbcc-750bb9dc4e5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:01.024713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6cef907a-12ac-4736-bbcc-750bb9dc4e5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:01.039460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef907a-12ac-4736-bbcc-750bb9dc4e5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:01.042172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef907a-12ac-4736-bbcc-750bb9dc4e5b service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:01.061185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702cd6a-5d84-40e0-9f8d-5448bc60fece service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:01.064731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1111/2192] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:01.084014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fef8a-9479-4fed-bd8a-cd87fdbd07dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:01.092043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fef8a-9479-4fed-bd8a-cd87fdbd07dd service placement] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:01.092043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fef8a-9479-4fed-bd8a-cd87fdbd07dd service placement] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:01.092043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fef8a-9479-4fed-bd8a-cd87fdbd07dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:01.098844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fef8a-9479-4fed-bd8a-cd87fdbd07dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:01.102170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fef8a-9479-4fed-bd8a-cd87fdbd07dd service placement] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:01.112874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1082/2193] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:06:03.897709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5c3f7-418b-4bcc-8393-c07adca86696 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:03.898296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5c3f7-418b-4bcc-8393-c07adca86696 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:03.898296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5c3f7-418b-4bcc-8393-c07adca86696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:03.920184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ffe5c3f7-418b-4bcc-8393-c07adca86696 None None] MFA Rules not processed for user `deee2d42d2284c69aca96cbbef51650d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:03.921410 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ffe5c3f7-418b-4bcc-8393-c07adca86696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:03.929988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1112/2194] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:06:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:04.451533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a69de4-7f36-44d4-9a7a-cced2618159a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.453888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a69de4-7f36-44d4-9a7a-cced2618159a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.453888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a69de4-7f36-44d4-9a7a-cced2618159a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.453888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1083/2195] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:04.460013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d6a4-2223-4583-9fcb-259f00f4f696 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.460373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d6a4-2223-4583-9fcb-259f00f4f696 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.460768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d6a4-2223-4583-9fcb-259f00f4f696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.484081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ef92d6a4-2223-4583-9fcb-259f00f4f696 None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:04.486960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ef92d6a4-2223-4583-9fcb-259f00f4f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.569604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1113/2196] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:06:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:04.581159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a69de4-7f36-44d4-9a7a-cced2618159a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:04.582855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-26a69de4-7f36-44d4-9a7a-cced2618159a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.598507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a69de4-7f36-44d4-9a7a-cced2618159a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:04.604588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b4f46-98db-4a00-8429-fdf673f7474e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79bb81300cff46b7ba1680eedf2762cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:04.606228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b4f46-98db-4a00-8429-fdf673f7474e service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.607036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b4f46-98db-4a00-8429-fdf673f7474e service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.607907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b4f46-98db-4a00-8429-fdf673f7474e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.647683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b4f46-98db-4a00-8429-fdf673f7474e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:04.650240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b4f46-98db-4a00-8429-fdf673f7474e service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:04.672573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1084/2197] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:04.898933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a834-c93d-4e44-ae91-24c361693c6f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.899423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a834-c93d-4e44-ae91-24c361693c6f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.899526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a834-c93d-4e44-ae91-24c361693c6f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.901865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1114/2198] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:04.908484 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2bc7e-4c17-4b68-a6d5-d6dcad1e2643 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:04.908985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2bc7e-4c17-4b68-a6d5-d6dcad1e2643 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:04.909265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2bc7e-4c17-4b68-a6d5-d6dcad1e2643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:04.929072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-bca2bc7e-4c17-4b68-a6d5-d6dcad1e2643 None None] MFA Rules not processed for user `321d07f93b7540128dc5415d8b3252c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:04.930401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bca2bc7e-4c17-4b68-a6d5-d6dcad1e2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:04.994607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1085/2199] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:06:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:05.014530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321a834-c93d-4e44-ae91-24c361693c6f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:05.017718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8321a834-c93d-4e44-ae91-24c361693c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:05.034940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321a834-c93d-4e44-ae91-24c361693c6f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:05.038699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108de7e-5977-41e6-ad5f-f1495607fb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:05.039586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108de7e-5977-41e6-ad5f-f1495607fb10 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:05.039924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108de7e-5977-41e6-ad5f-f1495607fb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:05.040262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108de7e-5977-41e6-ad5f-f1495607fb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:05.048570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108de7e-5977-41e6-ad5f-f1495607fb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:05.050111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108de7e-5977-41e6-ad5f-f1495607fb10 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:05.058517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1115/2200] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:05.182403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44640e6-0173-4590-a885-c209671445c9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:05.182783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44640e6-0173-4590-a885-c209671445c9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:05.183207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44640e6-0173-4590-a885-c209671445c9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:05.186004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1086/2201] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:06:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:05.193220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73d60-4408-49fa-b367-8da10872482b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:05.193699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73d60-4408-49fa-b367-8da10872482b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:05.194052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73d60-4408-49fa-b367-8da10872482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:05.217759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e1c73d60-4408-49fa-b367-8da10872482b None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:05.217759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e1c73d60-4408-49fa-b367-8da10872482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:05.227864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1116/2202] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:06:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:05.238428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44640e6-0173-4590-a885-c209671445c9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:05.249271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44640e6-0173-4590-a885-c209671445c9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:05.253819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49cf94-2d2a-4e24-851f-2b40371e52cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:05.255443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49cf94-2d2a-4e24-851f-2b40371e52cc service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:05.255750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49cf94-2d2a-4e24-851f-2b40371e52cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:05.256030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49cf94-2d2a-4e24-851f-2b40371e52cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:05.269355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49cf94-2d2a-4e24-851f-2b40371e52cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:05.270836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49cf94-2d2a-4e24-851f-2b40371e52cc service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:05.283508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1087/2203] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:07.196818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa03ec3-76cd-4d1e-8dfa-96f905dbed8b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:07.197239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa03ec3-76cd-4d1e-8dfa-96f905dbed8b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:07.197363 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa03ec3-76cd-4d1e-8dfa-96f905dbed8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:07.218413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-efa03ec3-76cd-4d1e-8dfa-96f905dbed8b None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:07.220458 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-efa03ec3-76cd-4d1e-8dfa-96f905dbed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:07.227730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1117/2204] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:06:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:07.239836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49cf94-2d2a-4e24-851f-2b40371e52cc service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:07.251343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49cf94-2d2a-4e24-851f-2b40371e52cc service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:07.256589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296a83-c1d0-4d4e-ac84-d6edba50a953 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:07.257265 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296a83-c1d0-4d4e-ac84-d6edba50a953 service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:07.257603 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296a83-c1d0-4d4e-ac84-d6edba50a953 service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:07.258324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74296a83-c1d0-4d4e-ac84-d6edba50a953 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:07.268225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74296a83-c1d0-4d4e-ac84-d6edba50a953 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:07.269859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74296a83-c1d0-4d4e-ac84-d6edba50a953 service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:07.278007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1088/2205] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:06:10.931046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55faae-0cd2-40e1-9804-10cff102b152 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:10.931963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55faae-0cd2-40e1-9804-10cff102b152 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:10.932400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55faae-0cd2-40e1-9804-10cff102b152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:10.977656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-df55faae-0cd2-40e1-9804-10cff102b152 None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:10.980586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-df55faae-0cd2-40e1-9804-10cff102b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:11.014626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1118/2206] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:06:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:11.035042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296a83-c1d0-4d4e-ac84-d6edba50a953 service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:11.052295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74296a83-c1d0-4d4e-ac84-d6edba50a953 service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:11.058554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fedfda-f042-4c7c-ba53-fb1e2dce2802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:11.060946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fedfda-f042-4c7c-ba53-fb1e2dce2802 service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:11.060946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fedfda-f042-4c7c-ba53-fb1e2dce2802 service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:11.060946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fedfda-f042-4c7c-ba53-fb1e2dce2802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:11.075511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fedfda-f042-4c7c-ba53-fb1e2dce2802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:11.077629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fedfda-f042-4c7c-ba53-fb1e2dce2802 service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:11.093854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1089/2207] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:06:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:06:13.174838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff086874-b699-4e5e-b3a3-37553313ec12 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:13.176463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff086874-b699-4e5e-b3a3-37553313ec12 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:13.176999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff086874-b699-4e5e-b3a3-37553313ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:13.206883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ff086874-b699-4e5e-b3a3-37553313ec12 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:13.208457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ff086874-b699-4e5e-b3a3-37553313ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:13.413575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:13.540929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1119/2208] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:13.907388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fedfda-f042-4c7c-ba53-fb1e2dce2802 service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:13.909128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-72fedfda-f042-4c7c-ba53-fb1e2dce2802 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:13.947742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fedfda-f042-4c7c-ba53-fb1e2dce2802 service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:13.965609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f34a2-85f4-4f13-a5fd-5f2e9dcee627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:13.966540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f34a2-85f4-4f13-a5fd-5f2e9dcee627 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:13.966824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f34a2-85f4-4f13-a5fd-5f2e9dcee627 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:13.967156 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f34a2-85f4-4f13-a5fd-5f2e9dcee627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:13.986721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f34a2-85f4-4f13-a5fd-5f2e9dcee627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:13.988982 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f34a2-85f4-4f13-a5fd-5f2e9dcee627 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:14.004357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1090/2209] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:23.615326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=8 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:23.997749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=85 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:25.912589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7589617-f149-4b55-b6a1-c2e29845f2d9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:25.912589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7589617-f149-4b55-b6a1-c2e29845f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:25.912589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7589617-f149-4b55-b6a1-c2e29845f2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:25.920722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d7589617-f149-4b55-b6a1-c2e29845f2d9 None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:25.922731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d7589617-f149-4b55-b6a1-c2e29845f2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:25.930432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1120/2210] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 08:06:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:25.944517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f34a2-85f4-4f13-a5fd-5f2e9dcee627 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:25.956249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f34a2-85f4-4f13-a5fd-5f2e9dcee627 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:25.961132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667222-0a08-4414-b95b-5002c3f297ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:25.961752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667222-0a08-4414-b95b-5002c3f297ce service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:25.962029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667222-0a08-4414-b95b-5002c3f297ce service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:25.962300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667222-0a08-4414-b95b-5002c3f297ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:25.971109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69667222-0a08-4414-b95b-5002c3f297ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:25.972703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69667222-0a08-4414-b95b-5002c3f297ce service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:25.980661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1091/2211] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:06:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:06:27.213594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39d279-fc5b-46e6-abdf-2e94bcdb4f5a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:27.214116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39d279-fc5b-46e6-abdf-2e94bcdb4f5a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:27.214230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39d279-fc5b-46e6-abdf-2e94bcdb4f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:27.233825 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ad39d279-fc5b-46e6-abdf-2e94bcdb4f5a None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:27.235136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ad39d279-fc5b-46e6-abdf-2e94bcdb4f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:27.242591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1121/2212] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:06:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:27.256213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667222-0a08-4414-b95b-5002c3f297ce service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:27.267606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667222-0a08-4414-b95b-5002c3f297ce service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:27.272942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aa221-2561-433c-b22b-6e5128be0b35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:27.273581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa221-2561-433c-b22b-6e5128be0b35 service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:27.273861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa221-2561-433c-b22b-6e5128be0b35 service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:27.274132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa221-2561-433c-b22b-6e5128be0b35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:27.282579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4aa221-2561-433c-b22b-6e5128be0b35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:27.284193 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4aa221-2561-433c-b22b-6e5128be0b35 service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:27.292775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1092/2213] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:06:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:06:29.460630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39d279-fc5b-46e6-abdf-2e94bcdb4f5a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:29.462466 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ad39d279-fc5b-46e6-abdf-2e94bcdb4f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:29.481575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39d279-fc5b-46e6-abdf-2e94bcdb4f5a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:29.487470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:29.488162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:29.488599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:29.494415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] PATH_INFO: `/v3/users/942b805b400042238a94cc1955a7a709` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:29.494415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942b805b400042238a94cc1955a7a709)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:29.494415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:29.573244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7b114-bc60-44ea-a688-42ede5750689 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:29.573925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7b114-bc60-44ea-a688-42ede5750689 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:29.573925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7b114-bc60-44ea-a688-42ede5750689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:29.595231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-66b7b114-bc60-44ea-a688-42ede5750689 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:29.597738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-66b7b114-bc60-44ea-a688-42ede5750689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:29.606965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1093/2214] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:06:29.636132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7b114-bc60-44ea-a688-42ede5750689 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:29.652426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7b114-bc60-44ea-a688-42ede5750689 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:29.659688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99895e-7e4a-4240-9650-e66fa4ef3420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:29.660301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99895e-7e4a-4240-9650-e66fa4ef3420 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:29.660612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99895e-7e4a-4240-9650-e66fa4ef3420 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:29.660885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99895e-7e4a-4240-9650-e66fa4ef3420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:29.670516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99895e-7e4a-4240-9650-e66fa4ef3420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:29.672703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99895e-7e4a-4240-9650-e66fa4ef3420 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:29.684224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1094/2215] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:06:30.270455 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942b805b400042238a94cc1955a7a709'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.271801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942b805b400042238a94cc1955a7a709'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.272694 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942b805b400042238a94cc1955a7a709'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.350227 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942b805b400042238a94cc1955a7a709'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.363160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-326f87f4-34d7-4841-a5c0-b51b71fd56d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942b805b400042238a94cc1955a7a709'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:30.375886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1122/2216] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:29 2022] DELETE /identity/v3/users/942b805b400042238a94cc1955a7a709 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:30.772425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99895e-7e4a-4240-9650-e66fa4ef3420 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:30.796480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99895e-7e4a-4240-9650-e66fa4ef3420 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:30.898730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:30.899958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:30.900481 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:30.900914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] PATH_INFO: `/v3/projects/d826ac40b60a4c948117fba52659b347` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:30.902895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d826ac40b60a4c948117fba52659b347)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:30.905343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.042936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd826ac40b60a4c948117fba52659b347', 'request_id': 'req-4a2ad975-a6a4-4c4d-8555-4244319e6623'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.053113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd826ac40b60a4c948117fba52659b347', 'request_id': 'req-4a2ad975-a6a4-4c4d-8555-4244319e6623'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.063459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd826ac40b60a4c948117fba52659b347', 'request_id': 'req-4a2ad975-a6a4-4c4d-8555-4244319e6623'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.138778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] The token cache is being invalidate because project d826ac40b60a4c948117fba52659b347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:31.139058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.141882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a2ad975-a6a4-4c4d-8555-4244319e6623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:31.143746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1095/2217] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:30 2022] DELETE /identity/v3/projects/d826ac40b60a4c948117fba52659b347 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:31.148604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ab59b-86a2-4ec1-870c-5b7e914f7b44 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.149148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ab59b-86a2-4ec1-870c-5b7e914f7b44 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.149148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ab59b-86a2-4ec1-870c-5b7e914f7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.183565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-560ab59b-86a2-4ec1-870c-5b7e914f7b44 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:31.184778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-560ab59b-86a2-4ec1-870c-5b7e914f7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:31.248520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1123/2218] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:31.257151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718e938-7828-4de6-9c95-daf6197da3ba None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.257431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718e938-7828-4de6-9c95-daf6197da3ba None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.257873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718e938-7828-4de6-9c95-daf6197da3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.282303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0718e938-7828-4de6-9c95-daf6197da3ba None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:31.283724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0718e938-7828-4de6-9c95-daf6197da3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:31.292347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1096/2219] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:31.296762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ab59b-86a2-4ec1-870c-5b7e914f7b44 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.308420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ab59b-86a2-4ec1-870c-5b7e914f7b44 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.313988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a2b4-9755-4ce2-abf9-d2dfe7c53b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.315803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a2b4-9755-4ce2-abf9-d2dfe7c53b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.316079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a2b4-9755-4ce2-abf9-d2dfe7c53b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.316367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a2b4-9755-4ce2-abf9-d2dfe7c53b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.317016 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a2b4-9755-4ce2-abf9-d2dfe7c53b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:06:31.317318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a2b4-9755-4ce2-abf9-d2dfe7c53b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.319535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a2b4-9755-4ce2-abf9-d2dfe7c53b6a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.334025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1124/2220] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:06:31.338431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718e938-7828-4de6-9c95-daf6197da3ba None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.349410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718e938-7828-4de6-9c95-daf6197da3ba None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.354457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ad36-26ef-414f-9cfc-8cb4c53a43a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.355075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ad36-26ef-414f-9cfc-8cb4c53a43a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.355362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ad36-26ef-414f-9cfc-8cb4c53a43a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.355632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306ad36-26ef-414f-9cfc-8cb4c53a43a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.356351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306ad36-26ef-414f-9cfc-8cb4c53a43a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.358593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306ad36-26ef-414f-9cfc-8cb4c53a43a6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.463035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1097/2221] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:31.470781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a2b4-9755-4ce2-abf9-d2dfe7c53b6a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.482039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a2b4-9755-4ce2-abf9-d2dfe7c53b6a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.538691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:31.552310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118589a-1e7c-4fa3-8231-89941eebec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.554233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118589a-1e7c-4fa3-8231-89941eebec7f admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.554233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118589a-1e7c-4fa3-8231-89941eebec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.554233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118589a-1e7c-4fa3-8231-89941eebec7f admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.554809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118589a-1e7c-4fa3-8231-89941eebec7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.556812 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118589a-1e7c-4fa3-8231-89941eebec7f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.722101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1125/2222] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:06:31.726221 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ad36-26ef-414f-9cfc-8cb4c53a43a6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.736577 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306ad36-26ef-414f-9cfc-8cb4c53a43a6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.741142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25004ee-02f1-43e9-9690-ca6c45e55811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.741767 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25004ee-02f1-43e9-9690-ca6c45e55811 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.742046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25004ee-02f1-43e9-9690-ca6c45e55811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.742316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25004ee-02f1-43e9-9690-ca6c45e55811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.742956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25004ee-02f1-43e9-9690-ca6c45e55811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.744600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25004ee-02f1-43e9-9690-ca6c45e55811 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.756398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1098/2223] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:31.760590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118589a-1e7c-4fa3-8231-89941eebec7f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.774952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118589a-1e7c-4fa3-8231-89941eebec7f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.783071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcabd70-b26c-43eb-b8f8-4a51d34d5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.783743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcabd70-b26c-43eb-b8f8-4a51d34d5ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.784127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcabd70-b26c-43eb-b8f8-4a51d34d5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.784497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcabd70-b26c-43eb-b8f8-4a51d34d5ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.785195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcabd70-b26c-43eb-b8f8-4a51d34d5ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.787247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcabd70-b26c-43eb-b8f8-4a51d34d5ae8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.807638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1126/2224] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:06:31.808428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25004ee-02f1-43e9-9690-ca6c45e55811 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:31.818667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:31.823816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25004ee-02f1-43e9-9690-ca6c45e55811 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:31.836447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb064-787b-4053-9057-c964cb3468b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:31.840427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb064-787b-4053-9057-c964cb3468b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.840972 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb064-787b-4053-9057-c964cb3468b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.841451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb064-787b-4053-9057-c964cb3468b8 admin admin] PATH_INFO: `/v3/projects/5c30058be2da42458d72cb5a11976d76/users/e5fef911209549a8a45481f05ad769ba/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:31.867740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bb064-787b-4053-9057-c964cb3468b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c30058be2da42458d72cb5a11976d76, user_id=e5fef911209549a8a45481f05ad769ba, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:31.870679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bb064-787b-4053-9057-c964cb3468b8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:31.940024 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1099/2225] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:06:31 2022] PUT /identity/v3/projects/5c30058be2da42458d72cb5a11976d76/users/e5fef911209549a8a45481f05ad769ba/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:06:31.951343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8936-9a99-49f7-be14-cdb0df6b266e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:31.951676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8936-9a99-49f7-be14-cdb0df6b266e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:31.953111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8936-9a99-49f7-be14-cdb0df6b266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:32.000704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-00ab8936-9a99-49f7-be14-cdb0df6b266e None None] MFA Rules not processed for user `e5fef911209549a8a45481f05ad769ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:32.002037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-00ab8936-9a99-49f7-be14-cdb0df6b266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:32.106023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1127/2226] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:06:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:32.126056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb064-787b-4053-9057-c964cb3468b8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:32.127842 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4c4bb064-787b-4053-9057-c964cb3468b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:32.206184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb064-787b-4053-9057-c964cb3468b8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:32.210125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e633d75-7ff5-4081-8be8-375b6829d166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:32.210736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633d75-7ff5-4081-8be8-375b6829d166 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:32.211008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633d75-7ff5-4081-8be8-375b6829d166 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:32.211279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633d75-7ff5-4081-8be8-375b6829d166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:32.233082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e633d75-7ff5-4081-8be8-375b6829d166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:32.235196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e633d75-7ff5-4081-8be8-375b6829d166 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:32.254874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1100/2227] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:36.277870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8936-9a99-49f7-be14-cdb0df6b266e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:36.344547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8936-9a99-49f7-be14-cdb0df6b266e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:36.349383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:36.350795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:36.351081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:36.351534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] PATH_INFO: `/v3/users/e5fef911209549a8a45481f05ad769ba` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:36.354563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fef911209549a8a45481f05ad769ba)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:36.356777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:36.712153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fef911209549a8a45481f05ad769ba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:36.712836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fef911209549a8a45481f05ad769ba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:36.713449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fef911209549a8a45481f05ad769ba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:36.800296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fef911209549a8a45481f05ad769ba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:36.802712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:36.813437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fef911209549a8a45481f05ad769ba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:36.826245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1128/2228] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:06:36 2022] DELETE /identity/v3/users/e5fef911209549a8a45481f05ad769ba => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:36.831258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde71645-fc25-4a96-81d5-ffa96b470e54 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:36.831886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde71645-fc25-4a96-81d5-ffa96b470e54 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:36.832239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde71645-fc25-4a96-81d5-ffa96b470e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:36.855225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-bde71645-fc25-4a96-81d5-ffa96b470e54 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:36.857995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bde71645-fc25-4a96-81d5-ffa96b470e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:36.948061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1101/2229] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:36.960259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:36.961944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:37.049601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267438e6-6cc4-49f8-9cbc-fe2b29281bef admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:37.060803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2123afb-36f8-4b12-aed6-4d1688a72700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:37.061659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2123afb-36f8-4b12-aed6-4d1688a72700 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:37.065806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2123afb-36f8-4b12-aed6-4d1688a72700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:37.066170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2123afb-36f8-4b12-aed6-4d1688a72700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:37.081593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2123afb-36f8-4b12-aed6-4d1688a72700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:37.083211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2123afb-36f8-4b12-aed6-4d1688a72700 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:37.105318 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1129/2230] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:37.963014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde71645-fc25-4a96-81d5-ffa96b470e54 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:37.964581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bde71645-fc25-4a96-81d5-ffa96b470e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:37.978777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde71645-fc25-4a96-81d5-ffa96b470e54 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:37.985081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:37.986137 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:37.986573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:37.987009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] PATH_INFO: `/v3/projects/5c30058be2da42458d72cb5a11976d76` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:37.988414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c30058be2da42458d72cb5a11976d76)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:37.990688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:38.162322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c30058be2da42458d72cb5a11976d76', 'request_id': 'req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:38.167987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c30058be2da42458d72cb5a11976d76', 'request_id': 'req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:38.176059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c30058be2da42458d72cb5a11976d76', 'request_id': 'req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:38.447870 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] The token cache is being invalidate because project 5c30058be2da42458d72cb5a11976d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:06:38.448165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:38.448828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:06:38.450539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1102/2231] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:06:37 2022] DELETE /identity/v3/projects/5c30058be2da42458d72cb5a11976d76 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:06:45.848035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49d1e-ad57-4654-acfa-9b59ff37d130 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:45.848629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49d1e-ad57-4654-acfa-9b59ff37d130 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:45.848629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49d1e-ad57-4654-acfa-9b59ff37d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:45.870036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d6b49d1e-ad57-4654-acfa-9b59ff37d130 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:45.872003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d6b49d1e-ad57-4654-acfa-9b59ff37d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:45.946998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1130/2232] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:45.982673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:45.984252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:45.994337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:46.060419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a9d2c-c1e1-4859-a5ec-1cc84b911d49 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:46.068466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd48f6-3c01-4bba-99d5-56b21086d873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:46.069411 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd48f6-3c01-4bba-99d5-56b21086d873 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:46.069719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd48f6-3c01-4bba-99d5-56b21086d873 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:46.069986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd48f6-3c01-4bba-99d5-56b21086d873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:46.078792 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd48f6-3c01-4bba-99d5-56b21086d873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:46.080467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd48f6-3c01-4bba-99d5-56b21086d873 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:46.090762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1103/2233] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:51.084244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4c06-9574-4cc1-993a-32e5bc152b14 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:51.084752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4c06-9574-4cc1-993a-32e5bc152b14 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:51.084850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4c06-9574-4cc1-993a-32e5bc152b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:51.111135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e0ae4c06-9574-4cc1-993a-32e5bc152b14 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:51.112375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e0ae4c06-9574-4cc1-993a-32e5bc152b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:51.120388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1131/2234] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:51.176043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd48f6-3c01-4bba-99d5-56b21086d873 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:51.187947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd48f6-3c01-4bba-99d5-56b21086d873 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:51.193450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4677-6508-405a-8ffd-6271543f44a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:51.194081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4677-6508-405a-8ffd-6271543f44a8 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:51.194360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4677-6508-405a-8ffd-6271543f44a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:51.194634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4677-6508-405a-8ffd-6271543f44a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:51.203548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4677-6508-405a-8ffd-6271543f44a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:51.205876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4677-6508-405a-8ffd-6271543f44a8 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:51.216561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1104/2235] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:06:52.493046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734aa69b-1838-447c-8f94-8f8a8b9d55eb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.493630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734aa69b-1838-447c-8f94-8f8a8b9d55eb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.493743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734aa69b-1838-447c-8f94-8f8a8b9d55eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.518276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-734aa69b-1838-447c-8f94-8f8a8b9d55eb None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:52.521003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-734aa69b-1838-447c-8f94-8f8a8b9d55eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:52.583412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1132/2236] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 08:06:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:52.606139 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4677-6508-405a-8ffd-6271543f44a8 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.607662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3e8e4677-6508-405a-8ffd-6271543f44a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:52.679936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4677-6508-405a-8ffd-6271543f44a8 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.685062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fa716-0ba7-43f6-a568-217cda935c9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.685811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fa716-0ba7-43f6-a568-217cda935c9a service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.686671 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fa716-0ba7-43f6-a568-217cda935c9a service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.686949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fa716-0ba7-43f6-a568-217cda935c9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.695232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fa716-0ba7-43f6-a568-217cda935c9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.696935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fa716-0ba7-43f6-a568-217cda935c9a service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.705798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1105/2237] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:06:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:06:58.531676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ea9ba-fe93-4582-a356-5b619178db49 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.532182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ea9ba-fe93-4582-a356-5b619178db49 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.533120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ea9ba-fe93-4582-a356-5b619178db49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.553907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-fc6ea9ba-fe93-4582-a356-5b619178db49 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:58.555562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fc6ea9ba-fe93-4582-a356-5b619178db49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:58.564461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1133/2238] 10.222.0.49 () {58 vars in 1016 bytes} [Wed Aug 24 08:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:58.592173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fa716-0ba7-43f6-a568-217cda935c9a service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.594395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c61fa716-0ba7-43f6-a568-217cda935c9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:58.611946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fa716-0ba7-43f6-a568-217cda935c9a service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:58.618458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56a22-2f43-45bb-a16b-52dec6a6c4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:58.619531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56a22-2f43-45bb-a16b-52dec6a6c4d9 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:58.621269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56a22-2f43-45bb-a16b-52dec6a6c4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:58.621269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56a22-2f43-45bb-a16b-52dec6a6c4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:58.630380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56a22-2f43-45bb-a16b-52dec6a6c4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:58.632581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56a22-2f43-45bb-a16b-52dec6a6c4d9 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:58.646874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1106/2239] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:58.923909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ea9ba-fe93-4582-a356-5b619178db49 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:58.926589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fc6ea9ba-fe93-4582-a356-5b619178db49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:58.946940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:59.012607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ea9ba-fe93-4582-a356-5b619178db49 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:59.022313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a819c7-1aba-4a78-9a40-688101016b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:59.022965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a819c7-1aba-4a78-9a40-688101016b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:59.023211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a819c7-1aba-4a78-9a40-688101016b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:59.023483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a819c7-1aba-4a78-9a40-688101016b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:59.025260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-20a819c7-1aba-4a78-9a40-688101016b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:59.100160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a819c7-1aba-4a78-9a40-688101016b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:59.101636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a819c7-1aba-4a78-9a40-688101016b2d service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:59.113047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1134/2240] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:08.261921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf1f88-99d2-4cff-92bd-d190e06c64b0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:08.262405 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf1f88-99d2-4cff-92bd-d190e06c64b0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:08.262572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf1f88-99d2-4cff-92bd-d190e06c64b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:08.284650 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-51bf1f88-99d2-4cff-92bd-d190e06c64b0 None None] MFA Rules not processed for user `9870363844644da7ad0a353f8ebfeffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:08.286170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-51bf1f88-99d2-4cff-92bd-d190e06c64b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:08.349012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:08.357138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1107/2241] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:09.132164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=46 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:18.535638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b2ac-e3e6-4a1e-9c4e-efea34c4d876 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:18.536264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b2ac-e3e6-4a1e-9c4e-efea34c4d876 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:18.536264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b2ac-e3e6-4a1e-9c4e-efea34c4d876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:18.557062 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b812b2ac-e3e6-4a1e-9c4e-efea34c4d876 None None] MFA Rules not processed for user `af1baafb29de4485b4712a29fdfaf9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:18.558355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b812b2ac-e3e6-4a1e-9c4e-efea34c4d876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:18.629753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1135/2242] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:28.621037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=25 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:41.348884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf1f88-99d2-4cff-92bd-d190e06c64b0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:41.350336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-51bf1f88-99d2-4cff-92bd-d190e06c64b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:41.364519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf1f88-99d2-4cff-92bd-d190e06c64b0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:41.376815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:41.377483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:41.377769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:41.378040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] PATH_INFO: `/v3/users/126fe664eb114224b70f8ae9732fcd6b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:41.379363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126fe664eb114224b70f8ae9732fcd6b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:41.381320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:41.613009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126fe664eb114224b70f8ae9732fcd6b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:41.621025 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126fe664eb114224b70f8ae9732fcd6b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:41.626274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126fe664eb114224b70f8ae9732fcd6b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:41.626274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126fe664eb114224b70f8ae9732fcd6b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:41.724762 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-599da48a-0688-4c24-97a6-a224c316c032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126fe664eb114224b70f8ae9732fcd6b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:41.744155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1108/2243] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:41 2022] DELETE /identity/v3/users/126fe664eb114224b70f8ae9732fcd6b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:41.955394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b2ac-e3e6-4a1e-9c4e-efea34c4d876 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:41.968237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b2ac-e3e6-4a1e-9c4e-efea34c4d876 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.026637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.027262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.027540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.027806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] PATH_INFO: `/v3/projects/89bf4f83f34c4e49b47691a795223775` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.028908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89bf4f83f34c4e49b47691a795223775)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.030824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.106533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89bf4f83f34c4e49b47691a795223775', 'request_id': 'req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.111892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89bf4f83f34c4e49b47691a795223775', 'request_id': 'req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.118148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89bf4f83f34c4e49b47691a795223775', 'request_id': 'req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.188933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] The token cache is being invalidate because project 89bf4f83f34c4e49b47691a795223775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:42.189313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.190049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4232514b-a27c-4c2b-8eca-30f5c49fd9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:42.191566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1136/2244] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:41 2022] DELETE /identity/v3/projects/89bf4f83f34c4e49b47691a795223775 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:42.197919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f763e-8a06-45be-b1e3-8f51ad6ea189 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.198262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f763e-8a06-45be-b1e3-8f51ad6ea189 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.198482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f763e-8a06-45be-b1e3-8f51ad6ea189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.218592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d38f763e-8a06-45be-b1e3-8f51ad6ea189 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:42.220052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d38f763e-8a06-45be-b1e3-8f51ad6ea189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:42.285202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1109/2245] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:42.294240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e4f8d-7737-4558-a754-51d21952f34b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.294524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e4f8d-7737-4558-a754-51d21952f34b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.294798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e4f8d-7737-4558-a754-51d21952f34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.315874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b71e4f8d-7737-4558-a754-51d21952f34b None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:42.317118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b71e4f8d-7737-4558-a754-51d21952f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:42.326177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1137/2246] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:42.330538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f763e-8a06-45be-b1e3-8f51ad6ea189 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.340851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f763e-8a06-45be-b1e3-8f51ad6ea189 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.345693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09373cf0-2763-4faa-94b4-2cc8aa785c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.346307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09373cf0-2763-4faa-94b4-2cc8aa785c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.346581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09373cf0-2763-4faa-94b4-2cc8aa785c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.346845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09373cf0-2763-4faa-94b4-2cc8aa785c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.347525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09373cf0-2763-4faa-94b4-2cc8aa785c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:07:42.347818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09373cf0-2763-4faa-94b4-2cc8aa785c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.349420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09373cf0-2763-4faa-94b4-2cc8aa785c60 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.367264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1110/2247] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:07:42.373003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e4f8d-7737-4558-a754-51d21952f34b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.382749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e4f8d-7737-4558-a754-51d21952f34b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.387591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e3a92-7aea-4607-993e-533666d11999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.388207 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e3a92-7aea-4607-993e-533666d11999 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.388479 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e3a92-7aea-4607-993e-533666d11999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.388745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e3a92-7aea-4607-993e-533666d11999 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.389386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e3a92-7aea-4607-993e-533666d11999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.391418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e3a92-7aea-4607-993e-533666d11999 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.505830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1138/2248] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:42 2022] POST /identity/v3/projects => generated 397 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:42.510582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09373cf0-2763-4faa-94b4-2cc8aa785c60 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.522020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09373cf0-2763-4faa-94b4-2cc8aa785c60 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.582698 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098ad69-6753-4751-b862-1150463e8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.583305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098ad69-6753-4751-b862-1150463e8594 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.583582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098ad69-6753-4751-b862-1150463e8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.584001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098ad69-6753-4751-b862-1150463e8594 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.584683 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098ad69-6753-4751-b862-1150463e8594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.586729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098ad69-6753-4751-b862-1150463e8594 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.595433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:42.702432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1111/2249] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:42 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:42.706499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e3a92-7aea-4607-993e-533666d11999 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.717383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e3a92-7aea-4607-993e-533666d11999 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.721994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82a164-bdff-4511-ba2e-ea8f7ecb45cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.722585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82a164-bdff-4511-ba2e-ea8f7ecb45cf admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.722866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82a164-bdff-4511-ba2e-ea8f7ecb45cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.723135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82a164-bdff-4511-ba2e-ea8f7ecb45cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.723878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82a164-bdff-4511-ba2e-ea8f7ecb45cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.725475 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82a164-bdff-4511-ba2e-ea8f7ecb45cf admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.736432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1139/2250] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:42.740358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098ad69-6753-4751-b862-1150463e8594 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.750724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098ad69-6753-4751-b862-1150463e8594 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.755586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bec05-92d8-45db-8c9a-e882ec10bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.756177 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bec05-92d8-45db-8c9a-e882ec10bf34 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.756451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bec05-92d8-45db-8c9a-e882ec10bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.756719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bec05-92d8-45db-8c9a-e882ec10bf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.757354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bec05-92d8-45db-8c9a-e882ec10bf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.758983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bec05-92d8-45db-8c9a-e882ec10bf34 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.770355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1112/2251] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:42.774376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82a164-bdff-4511-ba2e-ea8f7ecb45cf admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:42.785511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82a164-bdff-4511-ba2e-ea8f7ecb45cf admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:42.790903 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6353c-86c1-47a7-95ca-3a6c7d9290eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:42.791642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6353c-86c1-47a7-95ca-3a6c7d9290eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.791950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6353c-86c1-47a7-95ca-3a6c7d9290eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.792322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6353c-86c1-47a7-95ca-3a6c7d9290eb admin admin] PATH_INFO: `/v3/projects/61ea17c9d10f4bcea83959ecacae8259/users/f9e4e23af48641a484766ccec28421cf/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.807137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6353c-86c1-47a7-95ca-3a6c7d9290eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ea17c9d10f4bcea83959ecacae8259, user_id=f9e4e23af48641a484766ccec28421cf, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:42.809869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6353c-86c1-47a7-95ca-3a6c7d9290eb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:42.890683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1140/2252] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:42 2022] PUT /identity/v3/projects/61ea17c9d10f4bcea83959ecacae8259/users/f9e4e23af48641a484766ccec28421cf/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:07:42.901646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463acb-8d66-4ccb-b79d-0090553c4e63 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:42.901929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463acb-8d66-4ccb-b79d-0090553c4e63 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:42.902198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8463acb-8d66-4ccb-b79d-0090553c4e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:42.929134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a8463acb-8d66-4ccb-b79d-0090553c4e63 None None] MFA Rules not processed for user `f9e4e23af48641a484766ccec28421cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:42.930459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a8463acb-8d66-4ccb-b79d-0090553c4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:42.993004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1113/2253] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:43.004563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6353c-86c1-47a7-95ca-3a6c7d9290eb admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:43.006396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4ff6353c-86c1-47a7-95ca-3a6c7d9290eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:43.039191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:43.066967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6353c-86c1-47a7-95ca-3a6c7d9290eb admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:43.070599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8457b3-1727-4b75-9940-6293d16c95d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:43.071203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8457b3-1727-4b75-9940-6293d16c95d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:43.071487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8457b3-1727-4b75-9940-6293d16c95d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:43.071760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8457b3-1727-4b75-9940-6293d16c95d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:43.080161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8457b3-1727-4b75-9940-6293d16c95d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:43.081616 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8457b3-1727-4b75-9940-6293d16c95d9 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:43.091349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1141/2254] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:48.599161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463acb-8d66-4ccb-b79d-0090553c4e63 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:48.600590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a8463acb-8d66-4ccb-b79d-0090553c4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:48.659116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8463acb-8d66-4ccb-b79d-0090553c4e63 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:48.662767 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68e4f3-bab1-493b-a008-4b1f8498a0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:48.663427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68e4f3-bab1-493b-a008-4b1f8498a0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:48.663704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68e4f3-bab1-493b-a008-4b1f8498a0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:48.663975 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68e4f3-bab1-493b-a008-4b1f8498a0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:48.666464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7a68e4f3-bab1-493b-a008-4b1f8498a0f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:48.739376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68e4f3-bab1-493b-a008-4b1f8498a0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:48.740884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68e4f3-bab1-493b-a008-4b1f8498a0f3 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:48.754863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1114/2255] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:49.033770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8457b3-1727-4b75-9940-6293d16c95d9 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:49.097914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8457b3-1727-4b75-9940-6293d16c95d9 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:49.103519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:49.104150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:49.104430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:49.104731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] PATH_INFO: `/v3/users/f9e4e23af48641a484766ccec28421cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:49.105908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e4e23af48641a484766ccec28421cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:49.107892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:49.270661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e4e23af48641a484766ccec28421cf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:49.271429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e4e23af48641a484766ccec28421cf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:49.272155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e4e23af48641a484766ccec28421cf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:49.347950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e4e23af48641a484766ccec28421cf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:49.361965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-69cffb48-b057-4f9c-b3a4-1a7fb60670a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e4e23af48641a484766ccec28421cf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:49.376276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1142/2256] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:07:49 2022] DELETE /identity/v3/users/f9e4e23af48641a484766ccec28421cf => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:49.380552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcae15-b013-431f-a05f-129d753e6b20 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:49.380832 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcae15-b013-431f-a05f-129d753e6b20 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:49.381102 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcae15-b013-431f-a05f-129d753e6b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:49.385031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998d9c9-cc5c-4bc6-8a6c-f187f1cc40c9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:49.385312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998d9c9-cc5c-4bc6-8a6c-f187f1cc40c9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:49.385626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998d9c9-cc5c-4bc6-8a6c-f187f1cc40c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:49.400759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-86bcae15-b013-431f-a05f-129d753e6b20 None None] MFA Rules not processed for user `145c02717fc04c4aa81829de41470262`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:49.402011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-86bcae15-b013-431f-a05f-129d753e6b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:49.405917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2998d9c9-cc5c-4bc6-8a6c-f187f1cc40c9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:49.406078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:49.407088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2998d9c9-cc5c-4bc6-8a6c-f187f1cc40c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:49.453251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:49.459973 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1115/2257] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:07:49.479681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1143/2258] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:49.489696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcae15-b013-431f-a05f-129d753e6b20 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:49.492567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-86bcae15-b013-431f-a05f-129d753e6b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:49.553089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcae15-b013-431f-a05f-129d753e6b20 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:49.557063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ff20-8328-486a-995a-ee1a23d24fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:49.557707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ff20-8328-486a-995a-ee1a23d24fcb service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:49.557985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ff20-8328-486a-995a-ee1a23d24fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:49.558253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ff20-8328-486a-995a-ee1a23d24fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:49.567153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ff20-8328-486a-995a-ee1a23d24fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:49.568572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ff20-8328-486a-995a-ee1a23d24fcb service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:49.578828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1116/2259] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:07:50.338172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998d9c9-cc5c-4bc6-8a6c-f187f1cc40c9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:50.339829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2998d9c9-cc5c-4bc6-8a6c-f187f1cc40c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:50.365404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998d9c9-cc5c-4bc6-8a6c-f187f1cc40c9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:50.379777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:50.379777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:50.379777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:50.379777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] PATH_INFO: `/v3/projects/61ea17c9d10f4bcea83959ecacae8259` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:50.380102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ea17c9d10f4bcea83959ecacae8259)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:50.380102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:50.502524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ea17c9d10f4bcea83959ecacae8259', 'request_id': 'req-4a171901-5869-4476-a578-f46d749840b4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:50.508689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ea17c9d10f4bcea83959ecacae8259', 'request_id': 'req-4a171901-5869-4476-a578-f46d749840b4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:50.515013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ea17c9d10f4bcea83959ecacae8259', 'request_id': 'req-4a171901-5869-4476-a578-f46d749840b4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:50.575819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] The token cache is being invalidate because project 61ea17c9d10f4bcea83959ecacae8259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:07:50.576111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:50.576763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4a171901-5869-4476-a578-f46d749840b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:07:50.579475 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1144/2260] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:07:50 2022] DELETE /identity/v3/projects/61ea17c9d10f4bcea83959ecacae8259 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:50.584705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d7b12-4232-4363-8bcc-644ff6210b95 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:50.585183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d7b12-4232-4363-8bcc-644ff6210b95 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:50.585281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d7b12-4232-4363-8bcc-644ff6210b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:50.606095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d08d7b12-4232-4363-8bcc-644ff6210b95 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:50.607296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d08d7b12-4232-4363-8bcc-644ff6210b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:50.670027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1117/2261] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:50.677889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b80a9d-a8fe-4714-9599-2f937bbe6867 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:50.678157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b80a9d-a8fe-4714-9599-2f937bbe6867 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:50.678424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b80a9d-a8fe-4714-9599-2f937bbe6867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:50.698257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-65b80a9d-a8fe-4714-9599-2f937bbe6867 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:50.699435 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-65b80a9d-a8fe-4714-9599-2f937bbe6867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:50.707200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1145/2262] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:50.711492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d7b12-4232-4363-8bcc-644ff6210b95 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:50.722096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d7b12-4232-4363-8bcc-644ff6210b95 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:50.726761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0915b-4de3-4584-a6bd-f1bae52debd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:50.727615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0915b-4de3-4584-a6bd-f1bae52debd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:50.727796 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0915b-4de3-4584-a6bd-f1bae52debd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:50.728051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0915b-4de3-4584-a6bd-f1bae52debd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:50.728740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0915b-4de3-4584-a6bd-f1bae52debd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:07:50.729119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0915b-4de3-4584-a6bd-f1bae52debd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:50.730878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0915b-4de3-4584-a6bd-f1bae52debd0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:50.744100 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1118/2263] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:07:50.748877 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b80a9d-a8fe-4714-9599-2f937bbe6867 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:50.758271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b80a9d-a8fe-4714-9599-2f937bbe6867 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:50.763677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44282589-3453-4104-b160-894af65ab6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:50.764277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282589-3453-4104-b160-894af65ab6ea admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:50.764553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282589-3453-4104-b160-894af65ab6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:50.764822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44282589-3453-4104-b160-894af65ab6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:50.765447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44282589-3453-4104-b160-894af65ab6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:50.767369 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44282589-3453-4104-b160-894af65ab6ea admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:50.875681 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1146/2264] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:50 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:50.879674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0915b-4de3-4584-a6bd-f1bae52debd0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:50.891303 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0915b-4de3-4584-a6bd-f1bae52debd0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:50.934216 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:50.949418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf1083-573c-4e4c-89e9-d3229971e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:50.950045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf1083-573c-4e4c-89e9-d3229971e298 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:50.950321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf1083-573c-4e4c-89e9-d3229971e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:50.950585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf1083-573c-4e4c-89e9-d3229971e298 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:50.951210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf1083-573c-4e4c-89e9-d3229971e298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:50.953354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf1083-573c-4e4c-89e9-d3229971e298 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:51.074054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1119/2265] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:50 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:51.078277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44282589-3453-4104-b160-894af65ab6ea admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:51.088690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44282589-3453-4104-b160-894af65ab6ea admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:51.093380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65825f9f-79e2-4218-aac8-935213d41dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:51.094034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65825f9f-79e2-4218-aac8-935213d41dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:51.094307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65825f9f-79e2-4218-aac8-935213d41dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:51.094576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65825f9f-79e2-4218-aac8-935213d41dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:51.095220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65825f9f-79e2-4218-aac8-935213d41dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:51.096804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65825f9f-79e2-4218-aac8-935213d41dd0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:51.107628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1147/2266] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:51.115333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf1083-573c-4e4c-89e9-d3229971e298 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:51.126095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf1083-573c-4e4c-89e9-d3229971e298 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:51.130858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f287bf7-7b89-40d9-8769-7447b9a97742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:51.131457 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f287bf7-7b89-40d9-8769-7447b9a97742 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:51.131740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f287bf7-7b89-40d9-8769-7447b9a97742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:51.132012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f287bf7-7b89-40d9-8769-7447b9a97742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:51.132651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f287bf7-7b89-40d9-8769-7447b9a97742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:51.134906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f287bf7-7b89-40d9-8769-7447b9a97742 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:51.145591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1120/2267] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:51.149927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65825f9f-79e2-4218-aac8-935213d41dd0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:51.159825 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65825f9f-79e2-4218-aac8-935213d41dd0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:51.164327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8170e-b503-4c12-964b-d8f3efda84aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:51.165126 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8170e-b503-4c12-964b-d8f3efda84aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:51.165414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8170e-b503-4c12-964b-d8f3efda84aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:51.165712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8170e-b503-4c12-964b-d8f3efda84aa admin admin] PATH_INFO: `/v3/projects/173df644f72f4f9b9fbcd5c1623cc89e/users/3ba741b1b62747a397193baa0b5b07a0/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:51.181005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8170e-b503-4c12-964b-d8f3efda84aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=173df644f72f4f9b9fbcd5c1623cc89e, user_id=3ba741b1b62747a397193baa0b5b07a0, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:51.184149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8170e-b503-4c12-964b-d8f3efda84aa admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:51.291586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1148/2268] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:51 2022] PUT /identity/v3/projects/173df644f72f4f9b9fbcd5c1623cc89e/users/3ba741b1b62747a397193baa0b5b07a0/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:51.296619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb441a-f13d-4e76-999d-cc039a17941d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:51.296909 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb441a-f13d-4e76-999d-cc039a17941d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:51.297186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb441a-f13d-4e76-999d-cc039a17941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:51.317847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-8ceb441a-f13d-4e76-999d-cc039a17941d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:51.318345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8170e-b503-4c12-964b-d8f3efda84aa admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:51.319055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8ceb441a-f13d-4e76-999d-cc039a17941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:51.320353 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d3d8170e-b503-4c12-964b-d8f3efda84aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:51.384446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8170e-b503-4c12-964b-d8f3efda84aa admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:51.388609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb790dc0-07d0-4be6-a5c8-9dac86a96842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:51.388783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1121/2269] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:51.389547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb790dc0-07d0-4be6-a5c8-9dac86a96842 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:51.389820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb790dc0-07d0-4be6-a5c8-9dac86a96842 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:51.390740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb790dc0-07d0-4be6-a5c8-9dac86a96842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:51.392571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-eb790dc0-07d0-4be6-a5c8-9dac86a96842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:51.401140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb441a-f13d-4e76-999d-cc039a17941d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:51.411178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb441a-f13d-4e76-999d-cc039a17941d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:51.415518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ed7c0-8a67-4631-9c3c-8395b35ebdc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:51.415924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ed7c0-8a67-4631-9c3c-8395b35ebdc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:51.416206 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ed7c0-8a67-4631-9c3c-8395b35ebdc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:51.416468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ed7c0-8a67-4631-9c3c-8395b35ebdc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:51.416647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:51.425653 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ed7c0-8a67-4631-9c3c-8395b35ebdc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:51.427075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ed7c0-8a67-4631-9c3c-8395b35ebdc2 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:51.436756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1122/2270] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:51.469563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb790dc0-07d0-4be6-a5c8-9dac86a96842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:51.471299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb790dc0-07d0-4be6-a5c8-9dac86a96842 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:51.484327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1149/2271] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:07:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:07:57.564944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234de47-4b16-49a2-80f6-8e358a4ede13 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:57.565489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234de47-4b16-49a2-80f6-8e358a4ede13 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:57.565724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234de47-4b16-49a2-80f6-8e358a4ede13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:57.596787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b234de47-4b16-49a2-80f6-8e358a4ede13 None None] MFA Rules not processed for user `3ba741b1b62747a397193baa0b5b07a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:07:57.598136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b234de47-4b16-49a2-80f6-8e358a4ede13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:07:57.665885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1123/2272] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:07:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:07:57.667957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb790dc0-07d0-4be6-a5c8-9dac86a96842 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:57.678642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb790dc0-07d0-4be6-a5c8-9dac86a96842 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:57.683622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1968-cd14-41fe-8f38-b5a982deed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:57.684228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1968-cd14-41fe-8f38-b5a982deed99 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:57.684509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1968-cd14-41fe-8f38-b5a982deed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:57.684780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1968-cd14-41fe-8f38-b5a982deed99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:57.685414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f1968-cd14-41fe-8f38-b5a982deed99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:57.687344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f1968-cd14-41fe-8f38-b5a982deed99 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:57.772037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1150/2273] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:07:57 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:07:57.776376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234de47-4b16-49a2-80f6-8e358a4ede13 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:57.788286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234de47-4b16-49a2-80f6-8e358a4ede13 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:57.830380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:57.850376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff21f2-1f2b-4cdd-b48b-5e54ea652125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:57.851016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff21f2-1f2b-4cdd-b48b-5e54ea652125 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:57.851275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff21f2-1f2b-4cdd-b48b-5e54ea652125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:57.851550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff21f2-1f2b-4cdd-b48b-5e54ea652125 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:57.852364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff21f2-1f2b-4cdd-b48b-5e54ea652125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:57.854944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff21f2-1f2b-4cdd-b48b-5e54ea652125 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:57.930977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1124/2274] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:07:57 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:07:57.935148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1968-cd14-41fe-8f38-b5a982deed99 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:57.946658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1968-cd14-41fe-8f38-b5a982deed99 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:57.951633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b87018-8520-4c03-bf7a-311ca40c35cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:57.952264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b87018-8520-4c03-bf7a-311ca40c35cb admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:57.952546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b87018-8520-4c03-bf7a-311ca40c35cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:57.952820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b87018-8520-4c03-bf7a-311ca40c35cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:57.953527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b87018-8520-4c03-bf7a-311ca40c35cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:57.955165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b87018-8520-4c03-bf7a-311ca40c35cb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:57.967809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1151/2275] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:07:57.971893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff21f2-1f2b-4cdd-b48b-5e54ea652125 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:57.983046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff21f2-1f2b-4cdd-b48b-5e54ea652125 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:57.987779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324d8e1-deb0-4e4c-b11c-af7a61f74281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:57.988917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324d8e1-deb0-4e4c-b11c-af7a61f74281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:57.988917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324d8e1-deb0-4e4c-b11c-af7a61f74281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:57.989091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324d8e1-deb0-4e4c-b11c-af7a61f74281 admin admin] PATH_INFO: `/v3/projects/cb531af4ea6b41e0b97a08db51b39fdd/users/22297cfacfa74a01b041a2879593293d/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:58.006641 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324d8e1-deb0-4e4c-b11c-af7a61f74281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb531af4ea6b41e0b97a08db51b39fdd, user_id=22297cfacfa74a01b041a2879593293d, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:58.010598 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324d8e1-deb0-4e4c-b11c-af7a61f74281 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:58.074446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1125/2276] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:57 2022] PUT /identity/v3/projects/cb531af4ea6b41e0b97a08db51b39fdd/users/22297cfacfa74a01b041a2879593293d/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:07:58.078966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b87018-8520-4c03-bf7a-311ca40c35cb admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:58.090776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b87018-8520-4c03-bf7a-311ca40c35cb admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:58.160635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6600ceb-cd04-4a2a-97b8-0ca566894d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:58.160980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6600ceb-cd04-4a2a-97b8-0ca566894d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:58.161330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6600ceb-cd04-4a2a-97b8-0ca566894d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:58.161794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6600ceb-cd04-4a2a-97b8-0ca566894d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:58.162506 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6600ceb-cd04-4a2a-97b8-0ca566894d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:58.164188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6600ceb-cd04-4a2a-97b8-0ca566894d9b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:58.182637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1152/2277] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:07:58.184200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324d8e1-deb0-4e4c-b11c-af7a61f74281 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:07:58.195556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324d8e1-deb0-4e4c-b11c-af7a61f74281 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:07:58.200687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a457319-dfd7-4eaf-89de-c5417d4b4bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:07:58.201458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457319-dfd7-4eaf-89de-c5417d4b4bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:07:58.201765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457319-dfd7-4eaf-89de-c5417d4b4bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:07:58.202041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a457319-dfd7-4eaf-89de-c5417d4b4bb5 admin admin] PATH_INFO: `/v3/projects/cb531af4ea6b41e0b97a08db51b39fdd/users/22297cfacfa74a01b041a2879593293d/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:07:58.204195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a457319-dfd7-4eaf-89de-c5417d4b4bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb531af4ea6b41e0b97a08db51b39fdd, user_id=22297cfacfa74a01b041a2879593293d, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:07:58.209602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a457319-dfd7-4eaf-89de-c5417d4b4bb5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:07:58.224794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1126/2278] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:07:58 2022] PUT /identity/v3/projects/cb531af4ea6b41e0b97a08db51b39fdd/users/22297cfacfa74a01b041a2879593293d/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:01.713838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6600ceb-cd04-4a2a-97b8-0ca566894d9b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:01.716960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b6600ceb-cd04-4a2a-97b8-0ca566894d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:01.833395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6600ceb-cd04-4a2a-97b8-0ca566894d9b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:01.844378 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:01.955999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda705c-eeec-493c-b283-0131d234e3fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:01.960213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda705c-eeec-493c-b283-0131d234e3fe service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:01.960213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda705c-eeec-493c-b283-0131d234e3fe service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:01.960213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda705c-eeec-493c-b283-0131d234e3fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:01.961092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4dda705c-eeec-493c-b283-0131d234e3fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:02.073923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda705c-eeec-493c-b283-0131d234e3fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:02.075809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda705c-eeec-493c-b283-0131d234e3fe service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:02.098513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1153/2279] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:08:04.261998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc579b-ff48-4be8-a944-da70ffa3641d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.262403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc579b-ff48-4be8-a944-da70ffa3641d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.262494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc579b-ff48-4be8-a944-da70ffa3641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.301364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cedc579b-ff48-4be8-a944-da70ffa3641d None None] MFA Rules not processed for user `22297cfacfa74a01b041a2879593293d`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:04.302633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cedc579b-ff48-4be8-a944-da70ffa3641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:04.387878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1127/2280] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:04.408089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda705c-eeec-493c-b283-0131d234e3fe service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:04.420817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda705c-eeec-493c-b283-0131d234e3fe service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:04.426957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd617bb-217a-4e70-a087-069bcb77b635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:04.427565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd617bb-217a-4e70-a087-069bcb77b635 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:04.427840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd617bb-217a-4e70-a087-069bcb77b635 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:04.428107 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd617bb-217a-4e70-a087-069bcb77b635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:04.499933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd617bb-217a-4e70-a087-069bcb77b635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:04.501847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd617bb-217a-4e70-a087-069bcb77b635 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:04.513047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1154/2281] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:05.389199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc579b-ff48-4be8-a944-da70ffa3641d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:05.391646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cedc579b-ff48-4be8-a944-da70ffa3641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:05.471927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc579b-ff48-4be8-a944-da70ffa3641d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:05.475652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:05.476374 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:05.477412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:05.477720 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:05.480065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:05.518195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:05.553764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:05.555497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:05.571849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1128/2282] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:07.567912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb8af-f227-49dc-a9af-ebd25f50ad54 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:07.568562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb8af-f227-49dc-a9af-ebd25f50ad54 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:07.568562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cb8af-f227-49dc-a9af-ebd25f50ad54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:07.590754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a82cb8af-f227-49dc-a9af-ebd25f50ad54 None None] MFA Rules not processed for user `3ba741b1b62747a397193baa0b5b07a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:07.592210 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a82cb8af-f227-49dc-a9af-ebd25f50ad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:07.599839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1155/2283] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:15.621671 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=13 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:17.583855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=82 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:21.073234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.074728 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.090475 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaad34-bf6c-4bd5-aa86-e74363ccc3d7 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.103902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa1c04-abcd-4e41-ad94-cbe6267125ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.103902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa1c04-abcd-4e41-ad94-cbe6267125ec service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.103902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa1c04-abcd-4e41-ad94-cbe6267125ec service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.103902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa1c04-abcd-4e41-ad94-cbe6267125ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.104482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b7aa1c04-abcd-4e41-ad94-cbe6267125ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.158162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa1c04-abcd-4e41-ad94-cbe6267125ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.159880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa1c04-abcd-4e41-ad94-cbe6267125ec service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.169118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1129/2284] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:23.598660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cb8af-f227-49dc-a9af-ebd25f50ad54 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.612674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cb8af-f227-49dc-a9af-ebd25f50ad54 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.619524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.620337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.620615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.621272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.623189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:23.635995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.637689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.648467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1156/2285] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:25.648644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa1c04-abcd-4e41-ad94-cbe6267125ec service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:25.714094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa1c04-abcd-4e41-ad94-cbe6267125ec service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:25.717845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e8271-f40c-4131-b748-991a54314286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:25.718439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e8271-f40c-4131-b748-991a54314286 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:25.718712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e8271-f40c-4131-b748-991a54314286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:25.718980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e8271-f40c-4131-b748-991a54314286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:25.720700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ba9e8271-f40c-4131-b748-991a54314286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:25.733734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e8271-f40c-4131-b748-991a54314286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:25.733734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e8271-f40c-4131-b748-991a54314286 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:25.740129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1130/2286] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:26.465484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:26.466897 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:26.538912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cd680-83f8-44da-9da6-bfd4a569b8e8 service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:26.544634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c630583-48bc-4749-9d3b-f722aea40408 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:26.545231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630583-48bc-4749-9d3b-f722aea40408 service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:26.545533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630583-48bc-4749-9d3b-f722aea40408 service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:26.545804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c630583-48bc-4749-9d3b-f722aea40408 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:26.547566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2c630583-48bc-4749-9d3b-f722aea40408 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:26.559621 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c630583-48bc-4749-9d3b-f722aea40408 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:26.561178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c630583-48bc-4749-9d3b-f722aea40408 service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:26.570983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1157/2287] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:33.694962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e8271-f40c-4131-b748-991a54314286 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.709054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e8271-f40c-4131-b748-991a54314286 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.718513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.719214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.719554 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.719880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.721729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.735277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.736902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.757663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1131/2288] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:35.376871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c630583-48bc-4749-9d3b-f722aea40408 service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:35.387321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c630583-48bc-4749-9d3b-f722aea40408 service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:35.391309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:35.391920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.392284 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.392450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.394217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:35.406070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:35.407558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:35.415999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1158/2289] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:35.615488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:35.617005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:35.635392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b4e1-6eec-42c7-99b8-ae82f45c6849 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:35.639568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea08c3-8793-44f6-951e-13fefc41dac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:35.640270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea08c3-8793-44f6-951e-13fefc41dac7 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.640623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea08c3-8793-44f6-951e-13fefc41dac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.640968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea08c3-8793-44f6-951e-13fefc41dac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.642877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7aea08c3-8793-44f6-951e-13fefc41dac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:35.711005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea08c3-8793-44f6-951e-13fefc41dac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:35.712520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea08c3-8793-44f6-951e-13fefc41dac7 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:35.725425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1132/2290] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:41.180511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:41.181862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:41.201135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f180d-380b-482a-95d4-d71969bdf8d9 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:41.206783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:41.207464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.209238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.209238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.210044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:41.221983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:41.223540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:41.233726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1159/2291] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:41.277274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cf3f6-dccb-4b30-b0f4-4867ddbfb6d3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.277824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cf3f6-dccb-4b30-b0f4-4867ddbfb6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.277917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cf3f6-dccb-4b30-b0f4-4867ddbfb6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.297809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-531cf3f6-dccb-4b30-b0f4-4867ddbfb6d3 None None] MFA Rules not processed for user `f98b5c461b014fd6962da1b044afed9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:41.299009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-531cf3f6-dccb-4b30-b0f4-4867ddbfb6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:41.315919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:41.332001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:41.334732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:41.357090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1133/2292] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:41.369872 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae73495-a99c-4d80-a6d1-fb4cb8ba9beb service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:41.375436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:41.377241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.377241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.377241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] PATH_INFO: `/v3/users/af1baafb29de4485b4712a29fdfaf9ed` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.378470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1baafb29de4485b4712a29fdfaf9ed)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:41.380759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:41.597448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1baafb29de4485b4712a29fdfaf9ed'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.598422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1baafb29de4485b4712a29fdfaf9ed'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.599024 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1baafb29de4485b4712a29fdfaf9ed'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.666208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1baafb29de4485b4712a29fdfaf9ed'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.681222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1baafb29de4485b4712a29fdfaf9ed'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.694179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1160/2293] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:41 2022] DELETE /identity/v3/users/af1baafb29de4485b4712a29fdfaf9ed => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:42.052957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cf3f6-dccb-4b30-b0f4-4867ddbfb6d3 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.052957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cf3f6-dccb-4b30-b0f4-4867ddbfb6d3 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:42.056388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.059551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.059551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.059551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.059883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.072684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.075031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.083742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1134/2294] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:42.191342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.197264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.256326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:42.280374 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.282881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.305939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e4401-5491-4876-88dd-9a7f42445e82 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:42.313330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.314019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.314298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.314630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] PATH_INFO: `/v3/projects/abe1334c35f34c06a5a97d5daee3c995` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.316009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe1334c35f34c06a5a97d5daee3c995)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.318325 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.400051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86452315-45db-4dd1-9133-beb0a474eb05 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:42.412063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f3474-e834-4fc0-b8d0-230a8e9311f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.412675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f3474-e834-4fc0-b8d0-230a8e9311f9 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.412950 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f3474-e834-4fc0-b8d0-230a8e9311f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.413272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f3474-e834-4fc0-b8d0-230a8e9311f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.415099 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-021f3474-e834-4fc0-b8d0-230a8e9311f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.435645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f3474-e834-4fc0-b8d0-230a8e9311f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.437384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f3474-e834-4fc0-b8d0-230a8e9311f9 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.448253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1135/2295] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:08:42.478571 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe1334c35f34c06a5a97d5daee3c995', 'request_id': 'req-47d4497a-1611-4cb8-9b88-66831a55dc85'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.484982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe1334c35f34c06a5a97d5daee3c995', 'request_id': 'req-47d4497a-1611-4cb8-9b88-66831a55dc85'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.491490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe1334c35f34c06a5a97d5daee3c995', 'request_id': 'req-47d4497a-1611-4cb8-9b88-66831a55dc85'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.554227 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] The token cache is being invalidate because project abe1334c35f34c06a5a97d5daee3c995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:42.554529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.555195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-47d4497a-1611-4cb8-9b88-66831a55dc85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.557044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1161/2296] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:42 2022] DELETE /identity/v3/projects/abe1334c35f34c06a5a97d5daee3c995 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:42.563361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bd294-3497-4953-9531-7dae5ec5b4d5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.563886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bd294-3497-4953-9531-7dae5ec5b4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.564164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bd294-3497-4953-9531-7dae5ec5b4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.617983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-db3bd294-3497-4953-9531-7dae5ec5b4d5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:42.619628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-db3bd294-3497-4953-9531-7dae5ec5b4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.682078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:42.694649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1136/2297] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:42.703558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a704d58-eb02-4715-975f-e1688d993bb7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.703558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a704d58-eb02-4715-975f-e1688d993bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.703558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a704d58-eb02-4715-975f-e1688d993bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.726737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2a704d58-eb02-4715-975f-e1688d993bb7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:42.728285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2a704d58-eb02-4715-975f-e1688d993bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.738360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1162/2298] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:42.742050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bd294-3497-4953-9531-7dae5ec5b4d5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.754858 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bd294-3497-4953-9531-7dae5ec5b4d5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:42.760408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75462034-c020-4528-bfb6-08fecd31f52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.761160 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75462034-c020-4528-bfb6-08fecd31f52d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.761763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75462034-c020-4528-bfb6-08fecd31f52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.762267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75462034-c020-4528-bfb6-08fecd31f52d admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.762949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75462034-c020-4528-bfb6-08fecd31f52d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:42.763316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75462034-c020-4528-bfb6-08fecd31f52d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.765045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75462034-c020-4528-bfb6-08fecd31f52d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.781425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1137/2299] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:42.782894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a704d58-eb02-4715-975f-e1688d993bb7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.793392 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a704d58-eb02-4715-975f-e1688d993bb7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:42.798379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b0b78-5e2c-4789-8406-dadd9768b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.799041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0b78-5e2c-4789-8406-dadd9768b4df admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.799383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0b78-5e2c-4789-8406-dadd9768b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.799719 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0b78-5e2c-4789-8406-dadd9768b4df admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.800412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b0b78-5e2c-4789-8406-dadd9768b4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.803676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b0b78-5e2c-4789-8406-dadd9768b4df admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.881031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1163/2300] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:42 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:42.882293 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75462034-c020-4528-bfb6-08fecd31f52d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.893694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75462034-c020-4528-bfb6-08fecd31f52d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:42.956393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5676a-e7b6-4943-8b86-ae4b0eb4d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.957001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5676a-e7b6-4943-8b86-ae4b0eb4d675 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.957272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5676a-e7b6-4943-8b86-ae4b0eb4d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.957571 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5676a-e7b6-4943-8b86-ae4b0eb4d675 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.958192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5676a-e7b6-4943-8b86-ae4b0eb4d675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.960170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5676a-e7b6-4943-8b86-ae4b0eb4d675 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.118173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1138/2301] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:42 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:43.122958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b0b78-5e2c-4789-8406-dadd9768b4df admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.133485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b0b78-5e2c-4789-8406-dadd9768b4df admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.138948 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c987ab-220a-4d1a-b4d2-33a6973e2fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.139757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c987ab-220a-4d1a-b4d2-33a6973e2fec admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.140035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c987ab-220a-4d1a-b4d2-33a6973e2fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.140303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c987ab-220a-4d1a-b4d2-33a6973e2fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.140943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c987ab-220a-4d1a-b4d2-33a6973e2fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.142597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c987ab-220a-4d1a-b4d2-33a6973e2fec admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.153644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1164/2302] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:43.157761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5676a-e7b6-4943-8b86-ae4b0eb4d675 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.169007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5676a-e7b6-4943-8b86-ae4b0eb4d675 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.173620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7d5c9-bcaa-401b-82fa-ec75085642da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.174242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7d5c9-bcaa-401b-82fa-ec75085642da admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.174518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7d5c9-bcaa-401b-82fa-ec75085642da admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.174799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7d5c9-bcaa-401b-82fa-ec75085642da admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.175430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7d5c9-bcaa-401b-82fa-ec75085642da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.177104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7d5c9-bcaa-401b-82fa-ec75085642da admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.188262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1139/2303] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:43.192505 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c987ab-220a-4d1a-b4d2-33a6973e2fec admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.204158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c987ab-220a-4d1a-b4d2-33a6973e2fec admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.208945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a290e2-a988-410e-a35b-8e02557c1d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.209640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a290e2-a988-410e-a35b-8e02557c1d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.209915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a290e2-a988-410e-a35b-8e02557c1d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.210186 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a290e2-a988-410e-a35b-8e02557c1d37 admin admin] PATH_INFO: `/v3/projects/ef404cb7b5ca433898d293ccaac2c62f/users/fa81c5396a2848798959636d60e284b3/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.225857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a290e2-a988-410e-a35b-8e02557c1d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef404cb7b5ca433898d293ccaac2c62f, user_id=fa81c5396a2848798959636d60e284b3, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.228600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a290e2-a988-410e-a35b-8e02557c1d37 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.307495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1165/2304] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:43 2022] PUT /identity/v3/projects/ef404cb7b5ca433898d293ccaac2c62f/users/fa81c5396a2848798959636d60e284b3/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:43.318845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826941c8-5275-476a-b70c-6dc9996db6b6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.319409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826941c8-5275-476a-b70c-6dc9996db6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.319409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826941c8-5275-476a-b70c-6dc9996db6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.350847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-826941c8-5275-476a-b70c-6dc9996db6b6 None None] MFA Rules not processed for user `fa81c5396a2848798959636d60e284b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:43.352081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-826941c8-5275-476a-b70c-6dc9996db6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.432875 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1140/2305] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:43.443994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a290e2-a988-410e-a35b-8e02557c1d37 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.445844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-81a290e2-a988-410e-a35b-8e02557c1d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.497533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:43.521556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a290e2-a988-410e-a35b-8e02557c1d37 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.527931 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ae4e6-9c1b-476b-bb57-40b1ec68779c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.528546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ae4e6-9c1b-476b-bb57-40b1ec68779c service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.528828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ae4e6-9c1b-476b-bb57-40b1ec68779c service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.529103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ae4e6-9c1b-476b-bb57-40b1ec68779c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.537594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ae4e6-9c1b-476b-bb57-40b1ec68779c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.539259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ae4e6-9c1b-476b-bb57-40b1ec68779c service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.549205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1166/2306] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:44.404385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8173f-1d2b-4cdd-aabb-6d3bb65456c2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.404939 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8173f-1d2b-4cdd-aabb-6d3bb65456c2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.404939 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8173f-1d2b-4cdd-aabb-6d3bb65456c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.425541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-96c8173f-1d2b-4cdd-aabb-6d3bb65456c2 None None] MFA Rules not processed for user `9870363844644da7ad0a353f8ebfeffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:44.429272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-96c8173f-1d2b-4cdd-aabb-6d3bb65456c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.475808 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:44.498523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1141/2307] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:46.578949 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ae4e6-9c1b-476b-bb57-40b1ec68779c service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.580541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7b2ae4e6-9c1b-476b-bb57-40b1ec68779c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.652909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ae4e6-9c1b-476b-bb57-40b1ec68779c service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.656622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bed365-1ff7-4451-90d6-9adc1ca38297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.657245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bed365-1ff7-4451-90d6-9adc1ca38297 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.657550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bed365-1ff7-4451-90d6-9adc1ca38297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.657822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bed365-1ff7-4451-90d6-9adc1ca38297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.661984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-63bed365-1ff7-4451-90d6-9adc1ca38297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.755792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bed365-1ff7-4451-90d6-9adc1ca38297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.757256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bed365-1ff7-4451-90d6-9adc1ca38297 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.769010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1167/2308] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:50.636409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8173f-1d2b-4cdd-aabb-6d3bb65456c2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:50.735468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8173f-1d2b-4cdd-aabb-6d3bb65456c2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:50.744510 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:50.746421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:50.746920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:50.747401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] PATH_INFO: `/v3/users/fa81c5396a2848798959636d60e284b3` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:50.749176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa81c5396a2848798959636d60e284b3)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:50.753409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:51.028562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa81c5396a2848798959636d60e284b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:51.042753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa81c5396a2848798959636d60e284b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:51.043700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa81c5396a2848798959636d60e284b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:51.044467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa81c5396a2848798959636d60e284b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:51.135778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa81c5396a2848798959636d60e284b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:51.164501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1142/2309] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:50 2022] DELETE /identity/v3/users/fa81c5396a2848798959636d60e284b3 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:51.169372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088d1ed-bacb-49d9-9b81-f3b9b5ca83ac None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:51.169909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088d1ed-bacb-49d9-9b81-f3b9b5ca83ac None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:51.170013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088d1ed-bacb-49d9-9b81-f3b9b5ca83ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:51.199965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4088d1ed-bacb-49d9-9b81-f3b9b5ca83ac None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:51.201293 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4088d1ed-bacb-49d9-9b81-f3b9b5ca83ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:51.280311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1168/2310] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:51.305773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:51.309879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:51.420575 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e296117-f9e0-4d11-bc37-80989dcea2e8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:51.424375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46b0e3-475f-47b3-aac7-74df9b300148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:51.424997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46b0e3-475f-47b3-aac7-74df9b300148 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:51.425266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46b0e3-475f-47b3-aac7-74df9b300148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:51.425590 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46b0e3-475f-47b3-aac7-74df9b300148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:51.437533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46b0e3-475f-47b3-aac7-74df9b300148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:51.439331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46b0e3-475f-47b3-aac7-74df9b300148 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:51.450328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1143/2311] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:52.570896 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088d1ed-bacb-49d9-9b81-f3b9b5ca83ac None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:52.575395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4088d1ed-bacb-49d9-9b81-f3b9b5ca83ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:52.599151 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088d1ed-bacb-49d9-9b81-f3b9b5ca83ac None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:52.608307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:52.608949 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:52.609222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:52.610457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] PATH_INFO: `/v3/projects/ef404cb7b5ca433898d293ccaac2c62f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:52.611816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef404cb7b5ca433898d293ccaac2c62f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:52.614768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:52.648436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:52.777103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef404cb7b5ca433898d293ccaac2c62f', 'request_id': 'req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:52.784763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef404cb7b5ca433898d293ccaac2c62f', 'request_id': 'req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:52.791816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef404cb7b5ca433898d293ccaac2c62f', 'request_id': 'req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:52.849533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] The token cache is being invalidate because project ef404cb7b5ca433898d293ccaac2c62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:52.849829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:52.850585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-15ccc1a4-abcd-4366-a5a1-f63ed9cc10ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:52.852143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1169/2312] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:52 2022] DELETE /identity/v3/projects/ef404cb7b5ca433898d293ccaac2c62f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:52.857191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664b95-3c5a-4a18-bdb1-fa9ea4fc37e4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:52.857730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664b95-3c5a-4a18-bdb1-fa9ea4fc37e4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:52.857891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664b95-3c5a-4a18-bdb1-fa9ea4fc37e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:52.878133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2e664b95-3c5a-4a18-bdb1-fa9ea4fc37e4 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:52.879337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2e664b95-3c5a-4a18-bdb1-fa9ea4fc37e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:52.893435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:52.953410 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1144/2313] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:52.955049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7c23-1eee-4277-a9f4-0e373a5c0505 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:52.955343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7c23-1eee-4277-a9f4-0e373a5c0505 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:52.955615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7c23-1eee-4277-a9f4-0e373a5c0505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:52.976604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-06be7c23-1eee-4277-a9f4-0e373a5c0505 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:52.978740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-06be7c23-1eee-4277-a9f4-0e373a5c0505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:52.985987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1170/2314] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:52.990411 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664b95-3c5a-4a18-bdb1-fa9ea4fc37e4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:53.000296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664b95-3c5a-4a18-bdb1-fa9ea4fc37e4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:53.004861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ea39e-32cd-4dcf-83a5-0d239b007eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:53.005449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ea39e-32cd-4dcf-83a5-0d239b007eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.007325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ea39e-32cd-4dcf-83a5-0d239b007eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.007325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ea39e-32cd-4dcf-83a5-0d239b007eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.007325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ea39e-32cd-4dcf-83a5-0d239b007eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:53.007325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ea39e-32cd-4dcf-83a5-0d239b007eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:53.008672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ea39e-32cd-4dcf-83a5-0d239b007eb9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:53.021027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1145/2315] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:53.025563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7c23-1eee-4277-a9f4-0e373a5c0505 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:53.035821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7c23-1eee-4277-a9f4-0e373a5c0505 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:53.040595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fcde5-1e50-485d-9ea1-74a9754805a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:53.041234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fcde5-1e50-485d-9ea1-74a9754805a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.041726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fcde5-1e50-485d-9ea1-74a9754805a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.042026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fcde5-1e50-485d-9ea1-74a9754805a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.042670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fcde5-1e50-485d-9ea1-74a9754805a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:53.044840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fcde5-1e50-485d-9ea1-74a9754805a6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:53.154589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1171/2316] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:53 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:53.159209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ea39e-32cd-4dcf-83a5-0d239b007eb9 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:53.169535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ea39e-32cd-4dcf-83a5-0d239b007eb9 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:53.228194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f4d65-2497-445f-868a-42fe35a37d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:53.228850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f4d65-2497-445f-868a-42fe35a37d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.229148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f4d65-2497-445f-868a-42fe35a37d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.230953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f4d65-2497-445f-868a-42fe35a37d4c admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.230953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f4d65-2497-445f-868a-42fe35a37d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:53.232284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f4d65-2497-445f-868a-42fe35a37d4c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:53.324188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1146/2317] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:53 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:53.328250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fcde5-1e50-485d-9ea1-74a9754805a6 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:53.339986 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fcde5-1e50-485d-9ea1-74a9754805a6 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:53.359952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957218c-145e-4cc8-a3f3-bb3b4ef7dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:53.360866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957218c-145e-4cc8-a3f3-bb3b4ef7dd00 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.361915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957218c-145e-4cc8-a3f3-bb3b4ef7dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.361915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957218c-145e-4cc8-a3f3-bb3b4ef7dd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.366631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957218c-145e-4cc8-a3f3-bb3b4ef7dd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:53.368757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957218c-145e-4cc8-a3f3-bb3b4ef7dd00 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:53.386719 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1172/2318] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:53.390929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f4d65-2497-445f-868a-42fe35a37d4c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:53.401444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f4d65-2497-445f-868a-42fe35a37d4c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:53.406230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ead7c-7572-4f52-ade5-5911e675247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:53.406834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ead7c-7572-4f52-ade5-5911e675247a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.407113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ead7c-7572-4f52-ade5-5911e675247a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.407388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ead7c-7572-4f52-ade5-5911e675247a admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.408031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ead7c-7572-4f52-ade5-5911e675247a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:53.418287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ead7c-7572-4f52-ade5-5911e675247a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:53.421319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1147/2319] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:53.425733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957218c-145e-4cc8-a3f3-bb3b4ef7dd00 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:53.437145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957218c-145e-4cc8-a3f3-bb3b4ef7dd00 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:53.447047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711ff17-1a68-4bb4-afce-2afaa93f6471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:53.447047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711ff17-1a68-4bb4-afce-2afaa93f6471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.447047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711ff17-1a68-4bb4-afce-2afaa93f6471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.447047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711ff17-1a68-4bb4-afce-2afaa93f6471 admin admin] PATH_INFO: `/v3/projects/414532bd78e24836b9f769195c4b9b95/users/bf582d612d1d469dbc74f6d03be469b3/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.459364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711ff17-1a68-4bb4-afce-2afaa93f6471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414532bd78e24836b9f769195c4b9b95, user_id=bf582d612d1d469dbc74f6d03be469b3, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:53.462214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711ff17-1a68-4bb4-afce-2afaa93f6471 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:53.538771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1173/2320] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:53 2022] PUT /identity/v3/projects/414532bd78e24836b9f769195c4b9b95/users/bf582d612d1d469dbc74f6d03be469b3/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:53.550607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448818-405a-4e0b-859a-6c5097667722 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.550912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448818-405a-4e0b-859a-6c5097667722 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.551222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7448818-405a-4e0b-859a-6c5097667722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.583800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e7448818-405a-4e0b-859a-6c5097667722 None None] MFA Rules not processed for user `bf582d612d1d469dbc74f6d03be469b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:53.585025 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e7448818-405a-4e0b-859a-6c5097667722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:53.654698 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1148/2321] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:53.659415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711ff17-1a68-4bb4-afce-2afaa93f6471 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:53.729220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711ff17-1a68-4bb4-afce-2afaa93f6471 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:53.734164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a27b6-40f2-444d-a2ff-62871da0b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:53.734775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a27b6-40f2-444d-a2ff-62871da0b9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.735054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a27b6-40f2-444d-a2ff-62871da0b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.735352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a27b6-40f2-444d-a2ff-62871da0b9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.736020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a27b6-40f2-444d-a2ff-62871da0b9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:53.737965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a27b6-40f2-444d-a2ff-62871da0b9b2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:53.844695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1174/2322] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:53 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:53.849036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448818-405a-4e0b-859a-6c5097667722 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:53.860499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7448818-405a-4e0b-859a-6c5097667722 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:53.870422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:53.920149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2e983-5127-4217-be40-d455c817fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:53.920773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2e983-5127-4217-be40-d455c817fca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.921060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2e983-5127-4217-be40-d455c817fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.921449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2e983-5127-4217-be40-d455c817fca4 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.922574 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2e983-5127-4217-be40-d455c817fca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:53.924208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2e983-5127-4217-be40-d455c817fca4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:54.040888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1149/2323] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:53 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:54.042813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a27b6-40f2-444d-a2ff-62871da0b9b2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:54.054148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a27b6-40f2-444d-a2ff-62871da0b9b2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:54.061722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7b7c2-451b-4952-8f5d-15cbeee41d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:54.061722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b7c2-451b-4952-8f5d-15cbeee41d3a admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:54.061722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b7c2-451b-4952-8f5d-15cbeee41d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:54.061722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7b7c2-451b-4952-8f5d-15cbeee41d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:54.062205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7b7c2-451b-4952-8f5d-15cbeee41d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:54.063242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7b7c2-451b-4952-8f5d-15cbeee41d3a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:54.075481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1175/2324] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:54.079179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2e983-5127-4217-be40-d455c817fca4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:54.091104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2e983-5127-4217-be40-d455c817fca4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:54.096313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb742102-172a-41a7-a660-8c08bfeb8f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:54.097042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb742102-172a-41a7-a660-8c08bfeb8f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:54.097418 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb742102-172a-41a7-a660-8c08bfeb8f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:54.097799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb742102-172a-41a7-a660-8c08bfeb8f58 admin admin] PATH_INFO: `/v3/projects/c9a01d913fe54442b6381402bce32135/users/2ed94abf433e40ff9c3c02a657bf3005/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:54.116143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb742102-172a-41a7-a660-8c08bfeb8f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a01d913fe54442b6381402bce32135, user_id=2ed94abf433e40ff9c3c02a657bf3005, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:54.119384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb742102-172a-41a7-a660-8c08bfeb8f58 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:54.210631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1150/2325] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:54 2022] PUT /identity/v3/projects/c9a01d913fe54442b6381402bce32135/users/2ed94abf433e40ff9c3c02a657bf3005/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:54.210802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7b7c2-451b-4952-8f5d-15cbeee41d3a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:54.212240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7b7c2-451b-4952-8f5d-15cbeee41d3a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:54.224950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:54.270108 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a16879-b333-42fa-9ba3-b82ffa6425d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:54.270722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a16879-b333-42fa-9ba3-b82ffa6425d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:54.271054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a16879-b333-42fa-9ba3-b82ffa6425d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:54.271328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a16879-b333-42fa-9ba3-b82ffa6425d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:54.272072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a16879-b333-42fa-9ba3-b82ffa6425d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:54.273714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a16879-b333-42fa-9ba3-b82ffa6425d5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:54.284432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1176/2326] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:54.288711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb742102-172a-41a7-a660-8c08bfeb8f58 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:54.299608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb742102-172a-41a7-a660-8c08bfeb8f58 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:54.304190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbdcb9-4439-4d07-a555-4950717be10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:54.304885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbdcb9-4439-4d07-a555-4950717be10c admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:54.305150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbdcb9-4439-4d07-a555-4950717be10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:54.305416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbdcb9-4439-4d07-a555-4950717be10c admin admin] PATH_INFO: `/v3/projects/c9a01d913fe54442b6381402bce32135/users/2ed94abf433e40ff9c3c02a657bf3005/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:54.307366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbdcb9-4439-4d07-a555-4950717be10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a01d913fe54442b6381402bce32135, user_id=2ed94abf433e40ff9c3c02a657bf3005, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:54.310007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbdcb9-4439-4d07-a555-4950717be10c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:54.326787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1151/2327] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:54 2022] PUT /identity/v3/projects/c9a01d913fe54442b6381402bce32135/users/2ed94abf433e40ff9c3c02a657bf3005/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:54.338964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06ff8a-d348-48b5-9acb-fb9519325ddb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:54.339241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06ff8a-d348-48b5-9acb-fb9519325ddb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:54.339508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06ff8a-d348-48b5-9acb-fb9519325ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:54.368258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-be06ff8a-d348-48b5-9acb-fb9519325ddb None None] MFA Rules not processed for user `2ed94abf433e40ff9c3c02a657bf3005`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:54.369719 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-be06ff8a-d348-48b5-9acb-fb9519325ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:54.438787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1177/2328] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:08:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:54.451583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbdcb9-4439-4d07-a555-4950717be10c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:54.453323 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-19bbdcb9-4439-4d07-a555-4950717be10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:54.512120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbdcb9-4439-4d07-a555-4950717be10c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:54.515704 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a1d79-c337-4667-9921-1a8ffbecd216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:54.516316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a1d79-c337-4667-9921-1a8ffbecd216 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:54.516576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a1d79-c337-4667-9921-1a8ffbecd216 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:54.516843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a1d79-c337-4667-9921-1a8ffbecd216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:54.528195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a1d79-c337-4667-9921-1a8ffbecd216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:54.529926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a1d79-c337-4667-9921-1a8ffbecd216 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:54.540228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1152/2329] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:54.773258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06ff8a-d348-48b5-9acb-fb9519325ddb None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:54.783417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06ff8a-d348-48b5-9acb-fb9519325ddb None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:54.787240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c56a7-76c1-4651-ae45-bb574b149ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:54.794254 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c56a7-76c1-4651-ae45-bb574b149ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:54.794254 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c56a7-76c1-4651-ae45-bb574b149ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:54.794254 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c56a7-76c1-4651-ae45-bb574b149ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:54.859178 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c56a7-76c1-4651-ae45-bb574b149ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:54.860728 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c56a7-76c1-4651-ae45-bb574b149ad1 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:54.871493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1178/2330] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:00.159444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd293e53-d261-4fe0-8a1c-c83a8928649c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:00.159948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd293e53-d261-4fe0-8a1c-c83a8928649c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:00.160040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd293e53-d261-4fe0-8a1c-c83a8928649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:00.181724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fd293e53-d261-4fe0-8a1c-c83a8928649c None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:00.183033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fd293e53-d261-4fe0-8a1c-c83a8928649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:00.253652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1153/2331] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 08:09:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:00.428488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c56a7-76c1-4651-ae45-bb574b149ad1 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:00.429993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-966c56a7-76c1-4651-ae45-bb574b149ad1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:00.481912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:00.517451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c56a7-76c1-4651-ae45-bb574b149ad1 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:00.522859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9adfb8-c572-4ed4-808c-e40a2207b2ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:00.528187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9adfb8-c572-4ed4-808c-e40a2207b2ba service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:00.528187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9adfb8-c572-4ed4-808c-e40a2207b2ba service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:00.528187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9adfb8-c572-4ed4-808c-e40a2207b2ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:00.535679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9adfb8-c572-4ed4-808c-e40a2207b2ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:00.537518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9adfb8-c572-4ed4-808c-e40a2207b2ba service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:00.547386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1179/2332] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:09:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:09:10.205406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd293e53-d261-4fe0-8a1c-c83a8928649c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:10.207062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fd293e53-d261-4fe0-8a1c-c83a8928649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:10.223029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:10.274557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd293e53-d261-4fe0-8a1c-c83a8928649c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:10.280433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:10.281055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.287753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.287753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] PATH_INFO: `/v3/users/deee2d42d2284c69aca96cbbef51650d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.287753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] RBAC: Authorizing `identity:delete_user(user_id=deee2d42d2284c69aca96cbbef51650d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:10.287753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:10.509213 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deee2d42d2284c69aca96cbbef51650d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:10.517039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deee2d42d2284c69aca96cbbef51650d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:10.517733 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deee2d42d2284c69aca96cbbef51650d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:10.518336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deee2d42d2284c69aca96cbbef51650d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:10.574301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deee2d42d2284c69aca96cbbef51650d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:10.591669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1154/2333] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:10 2022] DELETE /identity/v3/users/deee2d42d2284c69aca96cbbef51650d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:10.634653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=15 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:10.856685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9adfb8-c572-4ed4-808c-e40a2207b2ba service swift] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:10.867536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9adfb8-c572-4ed4-808c-e40a2207b2ba service swift] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:10.933769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:10.934395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.934675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.934944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] PATH_INFO: `/v3/projects/7c816f79bcff4072b904f6e351a828de` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.936064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c816f79bcff4072b904f6e351a828de)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:10.937999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:11.044036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c816f79bcff4072b904f6e351a828de', 'request_id': 'req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.049787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c816f79bcff4072b904f6e351a828de', 'request_id': 'req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.055992 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c816f79bcff4072b904f6e351a828de', 'request_id': 'req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.127621 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] The token cache is being invalidate because project 7c816f79bcff4072b904f6e351a828de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:11.127905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.128513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.130045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1180/2334] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:10 2022] DELETE /identity/v3/projects/7c816f79bcff4072b904f6e351a828de => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:11.134037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:11.135565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:11.148754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d7d4c-2cc1-4223-9aae-31619386b49d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:11.208390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:11.209262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:11.209587 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:11.209865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] PATH_INFO: `/v3/users/476b2b5bfd4d4270a21bb9fcdb89e921` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:11.210993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=476b2b5bfd4d4270a21bb9fcdb89e921)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:11.213843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:11.396249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:11.405860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476b2b5bfd4d4270a21bb9fcdb89e921'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.414670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476b2b5bfd4d4270a21bb9fcdb89e921'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.414670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476b2b5bfd4d4270a21bb9fcdb89e921'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.414670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476b2b5bfd4d4270a21bb9fcdb89e921'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.504650 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-45070a34-caa9-417f-ac6e-5df3e2a3fb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476b2b5bfd4d4270a21bb9fcdb89e921'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.522675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1155/2335] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:11 2022] DELETE /identity/v3/users/476b2b5bfd4d4270a21bb9fcdb89e921 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:11.741885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:11.743335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:11.757003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb79c7-f1c3-4983-a11e-af3c11b4364a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:11.826846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:11.827576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:11.827901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:11.828185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] PATH_INFO: `/v3/projects/abe3d60ea8d64ccfb9bfd65d01f55440` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:11.829316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe3d60ea8d64ccfb9bfd65d01f55440)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:11.831839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:11.940815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:11.954071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe3d60ea8d64ccfb9bfd65d01f55440', 'request_id': 'req-eab38269-22fd-434c-a712-72d0017d13b6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.959437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe3d60ea8d64ccfb9bfd65d01f55440', 'request_id': 'req-eab38269-22fd-434c-a712-72d0017d13b6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.966305 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe3d60ea8d64ccfb9bfd65d01f55440', 'request_id': 'req-eab38269-22fd-434c-a712-72d0017d13b6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:12.077263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] The token cache is being invalidate because project abe3d60ea8d64ccfb9bfd65d01f55440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:12.077489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:12.078119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:12.079620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1181/2336] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:11 2022] DELETE /identity/v3/projects/abe3d60ea8d64ccfb9bfd65d01f55440 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:16.194040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dd547-766e-4d6e-b812-853e9d7dc8e2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.194697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dd547-766e-4d6e-b812-853e9d7dc8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.194927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dd547-766e-4d6e-b812-853e9d7dc8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.215363 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fb2dd547-766e-4d6e-b812-853e9d7dc8e2 None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:16.216557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fb2dd547-766e-4d6e-b812-853e9d7dc8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:16.270959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1156/2337] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:09:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:16.283946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:16.285551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:16.359682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab38269-22fd-434c-a712-72d0017d13b6 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:16.364727 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8c40-9c73-4cf1-b69f-a90551f2a78a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:16.365353 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8c40-9c73-4cf1-b69f-a90551f2a78a service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.365649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8c40-9c73-4cf1-b69f-a90551f2a78a service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.365956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8c40-9c73-4cf1-b69f-a90551f2a78a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.375842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc8c40-9c73-4cf1-b69f-a90551f2a78a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:16.377497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc8c40-9c73-4cf1-b69f-a90551f2a78a service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:16.388743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1182/2338] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:09:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:09:26.264028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=41,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:26.382971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=44,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:34.342501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b207-f16b-488d-b3f6-d14da0bb7062 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.343223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b207-f16b-488d-b3f6-d14da0bb7062 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.343223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b207-f16b-488d-b3f6-d14da0bb7062 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.345725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1157/2339] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:09:34.355632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c3d2-59a7-445f-8693-a57827e4cbee None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.355632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c3d2-59a7-445f-8693-a57827e4cbee None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.355632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c3d2-59a7-445f-8693-a57827e4cbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.357619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b207-f16b-488d-b3f6-d14da0bb7062 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:34.359284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-add7b207-f16b-488d-b3f6-d14da0bb7062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:34.380373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5581c3d2-59a7-445f-8693-a57827e4cbee None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:34.381884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5581c3d2-59a7-445f-8693-a57827e4cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:34.437190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b207-f16b-488d-b3f6-d14da0bb7062 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:34.445650 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:34.446367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.446722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.447027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] PATH_INFO: `/v3/users/bf582d612d1d469dbc74f6d03be469b3` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.448179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf582d612d1d469dbc74f6d03be469b3)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:34.450212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:34.464209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1183/2340] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:09:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:34.479513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c3d2-59a7-445f-8693-a57827e4cbee None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:34.480959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5581c3d2-59a7-445f-8693-a57827e4cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:34.539340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c3d2-59a7-445f-8693-a57827e4cbee None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:34.543230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13803dad-ad30-419c-8ef6-17a8601b329e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79bb81300cff46b7ba1680eedf2762cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:34.543826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803dad-ad30-419c-8ef6-17a8601b329e service glance] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.544112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803dad-ad30-419c-8ef6-17a8601b329e service glance] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.544384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803dad-ad30-419c-8ef6-17a8601b329e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.555448 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13803dad-ad30-419c-8ef6-17a8601b329e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:34.557010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13803dad-ad30-419c-8ef6-17a8601b329e service glance] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:34.568667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1184/2341] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:34.638169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf582d612d1d469dbc74f6d03be469b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:34.645849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf582d612d1d469dbc74f6d03be469b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:34.646523 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf582d612d1d469dbc74f6d03be469b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:34.647148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf582d612d1d469dbc74f6d03be469b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:34.715224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc7c08cd-2d31-4dc9-ad45-086e29f0e301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf582d612d1d469dbc74f6d03be469b3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:34.733079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1158/2342] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:34 2022] DELETE /identity/v3/users/bf582d612d1d469dbc74f6d03be469b3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:34.737919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffc0dc-1efd-4c1b-ad6a-9d58aca82efb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.738206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffc0dc-1efd-4c1b-ad6a-9d58aca82efb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.738483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffc0dc-1efd-4c1b-ad6a-9d58aca82efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.757842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-75ffc0dc-1efd-4c1b-ad6a-9d58aca82efb None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:34.759034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-75ffc0dc-1efd-4c1b-ad6a-9d58aca82efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:34.798623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ed2e-23e9-4a90-a80c-6d5a0afe76da None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.798935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ed2e-23e9-4a90-a80c-6d5a0afe76da None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.799211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2ed2e-23e9-4a90-a80c-6d5a0afe76da None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.800559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1159/2343] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:09:34.805063 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba2fc-413d-4fbd-a7d9-b5f8d6409d3c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.805407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba2fc-413d-4fbd-a7d9-b5f8d6409d3c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.805852 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cba2fc-413d-4fbd-a7d9-b5f8d6409d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.818918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1185/2344] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:34.826721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-06cba2fc-413d-4fbd-a7d9-b5f8d6409d3c None None] MFA Rules not processed for user `321d07f93b7540128dc5415d8b3252c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:34.828060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-06cba2fc-413d-4fbd-a7d9-b5f8d6409d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:34.828480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffc0dc-1efd-4c1b-ad6a-9d58aca82efb None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:34.830697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-75ffc0dc-1efd-4c1b-ad6a-9d58aca82efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:34.871866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:34.881731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1160/2345] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:09:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:34.890433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffc0dc-1efd-4c1b-ad6a-9d58aca82efb None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:34.893648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba2fc-413d-4fbd-a7d9-b5f8d6409d3c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:34.894343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad94ff-442c-41f0-b65c-a75a9a0df3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:34.894962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad94ff-442c-41f0-b65c-a75a9a0df3fa service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.895231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad94ff-442c-41f0-b65c-a75a9a0df3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.895498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad94ff-442c-41f0-b65c-a75a9a0df3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.902062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cba2fc-413d-4fbd-a7d9-b5f8d6409d3c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:34.904790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad94ff-442c-41f0-b65c-a75a9a0df3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:34.905648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1f4a0-b3ab-4166-a844-69eb7783149b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:34.906242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1f4a0-b3ab-4166-a844-69eb7783149b service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.906356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad94ff-442c-41f0-b65c-a75a9a0df3fa service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:34.906515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1f4a0-b3ab-4166-a844-69eb7783149b service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.907377 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1f4a0-b3ab-4166-a844-69eb7783149b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.914786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1f4a0-b3ab-4166-a844-69eb7783149b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:34.916196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1f4a0-b3ab-4166-a844-69eb7783149b service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:34.917489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1186/2346] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:34.924260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1161/2347] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:35.027067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dde32-3de8-4839-9705-e2c285c47b30 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:35.027344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dde32-3de8-4839-9705-e2c285c47b30 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:35.027615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dde32-3de8-4839-9705-e2c285c47b30 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:35.029064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1187/2348] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 08:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:09:35.034935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b33bc3-b366-4e16-b97f-d03049fd7c63 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:35.035292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b33bc3-b366-4e16-b97f-d03049fd7c63 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:35.035625 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b33bc3-b366-4e16-b97f-d03049fd7c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:35.055878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-14b33bc3-b366-4e16-b97f-d03049fd7c63 None None] MFA Rules not processed for user `6ef753445d864a0ab30ec970446b29cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:35.057090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-14b33bc3-b366-4e16-b97f-d03049fd7c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:35.067387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:35.122094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1162/2349] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 08:09:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:35.133583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dde32-3de8-4839-9705-e2c285c47b30 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:35.135250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-305dde32-3de8-4839-9705-e2c285c47b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:35.149066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dde32-3de8-4839-9705-e2c285c47b30 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:35.152660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8677f4-3995-4c0e-890d-c107bba1495f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:35.153264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8677f4-3995-4c0e-890d-c107bba1495f service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:35.153562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8677f4-3995-4c0e-890d-c107bba1495f service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:35.156406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8677f4-3995-4c0e-890d-c107bba1495f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:35.164726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8677f4-3995-4c0e-890d-c107bba1495f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:35.166398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8677f4-3995-4c0e-890d-c107bba1495f service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:35.179862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1188/2350] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:35.421681 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b33bc3-b366-4e16-b97f-d03049fd7c63 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:35.423347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-14b33bc3-b366-4e16-b97f-d03049fd7c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:35.437029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b33bc3-b366-4e16-b97f-d03049fd7c63 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:35.442562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:35.444626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:35.444920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:35.445196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] PATH_INFO: `/v3/projects/414532bd78e24836b9f769195c4b9b95` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:35.446399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414532bd78e24836b9f769195c4b9b95)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:35.448320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:35.577036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414532bd78e24836b9f769195c4b9b95', 'request_id': 'req-b6daf582-026b-46f6-88d7-e67403742a67'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:35.583634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414532bd78e24836b9f769195c4b9b95', 'request_id': 'req-b6daf582-026b-46f6-88d7-e67403742a67'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:35.590549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414532bd78e24836b9f769195c4b9b95', 'request_id': 'req-b6daf582-026b-46f6-88d7-e67403742a67'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:35.671081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] The token cache is being invalidate because project 414532bd78e24836b9f769195c4b9b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:35.671314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:35.671963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:35.673561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1163/2351] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:35 2022] DELETE /identity/v3/projects/414532bd78e24836b9f769195c4b9b95 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:35.677736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8677f4-3995-4c0e-890d-c107bba1495f service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:35.688963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8677f4-3995-4c0e-890d-c107bba1495f service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:35.748059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:35.748603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:35.748884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:35.749182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] PATH_INFO: `/v3/users/2ed94abf433e40ff9c3c02a657bf3005` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:35.750330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed94abf433e40ff9c3c02a657bf3005)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:35.753007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:35.942083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed94abf433e40ff9c3c02a657bf3005'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:35.942650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed94abf433e40ff9c3c02a657bf3005'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:35.943237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed94abf433e40ff9c3c02a657bf3005'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:36.008366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed94abf433e40ff9c3c02a657bf3005'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:36.021289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2d8c628b-f1cc-4dc4-9c36-47f84b4cf272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed94abf433e40ff9c3c02a657bf3005'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:36.034425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1189/2352] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:35 2022] DELETE /identity/v3/users/2ed94abf433e40ff9c3c02a657bf3005 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:36.442165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:36.443594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:36.457248 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6daf582-026b-46f6-88d7-e67403742a67 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:36.515152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:36.515710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:36.516474 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:36.516863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] PATH_INFO: `/v3/projects/c9a01d913fe54442b6381402bce32135` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:36.518246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a01d913fe54442b6381402bce32135)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:36.520142 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:36.608848 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:36.621064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a01d913fe54442b6381402bce32135', 'request_id': 'req-66c60a0d-2b9a-4b03-9468-196213d10d8e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:36.627072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a01d913fe54442b6381402bce32135', 'request_id': 'req-66c60a0d-2b9a-4b03-9468-196213d10d8e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:36.633690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a01d913fe54442b6381402bce32135', 'request_id': 'req-66c60a0d-2b9a-4b03-9468-196213d10d8e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:36.724059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] The token cache is being invalidate because project c9a01d913fe54442b6381402bce32135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:36.724473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:36.725178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-66c60a0d-2b9a-4b03-9468-196213d10d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:36.726838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1164/2353] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:36 2022] DELETE /identity/v3/projects/c9a01d913fe54442b6381402bce32135 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:36.732032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed9670-6d07-4455-a62f-82177af59670 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:36.732523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed9670-6d07-4455-a62f-82177af59670 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:36.732752 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed9670-6d07-4455-a62f-82177af59670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:36.754507 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-08ed9670-6d07-4455-a62f-82177af59670 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:36.755800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-08ed9670-6d07-4455-a62f-82177af59670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:36.802248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:36.821838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1190/2354] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:36.830649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc31936-24bc-409d-9aeb-f74f695a4fd1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:36.830934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc31936-24bc-409d-9aeb-f74f695a4fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:36.831209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc31936-24bc-409d-9aeb-f74f695a4fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:36.855136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5cc31936-24bc-409d-9aeb-f74f695a4fd1 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:36.856251 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5cc31936-24bc-409d-9aeb-f74f695a4fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:36.868053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1165/2355] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:36.874590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed9670-6d07-4455-a62f-82177af59670 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:36.884931 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed9670-6d07-4455-a62f-82177af59670 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:36.890216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63236886-6100-45e7-a456-8d42d6c8a400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:36.890814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236886-6100-45e7-a456-8d42d6c8a400 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:36.891820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236886-6100-45e7-a456-8d42d6c8a400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:36.892093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236886-6100-45e7-a456-8d42d6c8a400 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:36.892732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63236886-6100-45e7-a456-8d42d6c8a400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:36.893022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63236886-6100-45e7-a456-8d42d6c8a400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:36.894655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63236886-6100-45e7-a456-8d42d6c8a400 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:36.906073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1191/2356] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:36.910631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc31936-24bc-409d-9aeb-f74f695a4fd1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:36.920222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc31936-24bc-409d-9aeb-f74f695a4fd1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:36.925030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712bc3e-0fef-4531-990b-3fd0e4f16779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:36.925664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712bc3e-0fef-4531-990b-3fd0e4f16779 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:36.925943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712bc3e-0fef-4531-990b-3fd0e4f16779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:36.926219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712bc3e-0fef-4531-990b-3fd0e4f16779 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:36.926853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712bc3e-0fef-4531-990b-3fd0e4f16779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:36.928739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712bc3e-0fef-4531-990b-3fd0e4f16779 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:37.057636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1166/2357] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:36 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:37.058906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63236886-6100-45e7-a456-8d42d6c8a400 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:37.069607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63236886-6100-45e7-a456-8d42d6c8a400 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:37.129202 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bb252-4b2d-4508-9162-eea49d334f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:37.129843 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bb252-4b2d-4508-9162-eea49d334f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.130121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bb252-4b2d-4508-9162-eea49d334f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.130390 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bb252-4b2d-4508-9162-eea49d334f2d admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.131011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bb252-4b2d-4508-9162-eea49d334f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:37.132981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bb252-4b2d-4508-9162-eea49d334f2d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:37.214485 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1192/2358] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:37 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:37.218890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712bc3e-0fef-4531-990b-3fd0e4f16779 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:37.230260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712bc3e-0fef-4531-990b-3fd0e4f16779 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:37.235758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92922740-a638-4d9f-808f-9c91ec6284aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:37.236455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92922740-a638-4d9f-808f-9c91ec6284aa admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.236737 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92922740-a638-4d9f-808f-9c91ec6284aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.237007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92922740-a638-4d9f-808f-9c91ec6284aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.237680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92922740-a638-4d9f-808f-9c91ec6284aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:37.239304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92922740-a638-4d9f-808f-9c91ec6284aa admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:37.250353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1167/2359] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:37.254679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bb252-4b2d-4508-9162-eea49d334f2d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:37.265032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bb252-4b2d-4508-9162-eea49d334f2d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:37.270028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd23c48-8b25-4722-aff2-a4a1cb4f5d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:37.270721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd23c48-8b25-4722-aff2-a4a1cb4f5d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.271072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd23c48-8b25-4722-aff2-a4a1cb4f5d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.271434 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd23c48-8b25-4722-aff2-a4a1cb4f5d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.272185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd23c48-8b25-4722-aff2-a4a1cb4f5d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:37.273852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd23c48-8b25-4722-aff2-a4a1cb4f5d20 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:37.284993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1193/2360] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:37.289220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92922740-a638-4d9f-808f-9c91ec6284aa admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:37.301562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92922740-a638-4d9f-808f-9c91ec6284aa admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:37.305242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f6610-b192-4afb-92c4-caf213044710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:37.306058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f6610-b192-4afb-92c4-caf213044710 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.306343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f6610-b192-4afb-92c4-caf213044710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.306617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f6610-b192-4afb-92c4-caf213044710 admin admin] PATH_INFO: `/v3/projects/fa9f8980506d41148c159938915cd8ec/users/0a0feb8063644777b3fc3248d460eb5d/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.322246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f6610-b192-4afb-92c4-caf213044710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9f8980506d41148c159938915cd8ec, user_id=0a0feb8063644777b3fc3248d460eb5d, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:37.325028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f6610-b192-4afb-92c4-caf213044710 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:37.407715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1168/2361] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:37 2022] PUT /identity/v3/projects/fa9f8980506d41148c159938915cd8ec/users/0a0feb8063644777b3fc3248d460eb5d/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:37.420114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fce117-1658-48a4-a74a-10cb5a1ed62a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.420397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fce117-1658-48a4-a74a-10cb5a1ed62a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.420666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fce117-1658-48a4-a74a-10cb5a1ed62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.449444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a3fce117-1658-48a4-a74a-10cb5a1ed62a None None] MFA Rules not processed for user `0a0feb8063644777b3fc3248d460eb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:37.450672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a3fce117-1658-48a4-a74a-10cb5a1ed62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:37.515671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1194/2362] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:37.520663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f6610-b192-4afb-92c4-caf213044710 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:37.585898 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f6610-b192-4afb-92c4-caf213044710 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:37.590525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85edbd-6ab1-44a4-827b-0f3947967bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:37.591126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85edbd-6ab1-44a4-827b-0f3947967bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.591492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85edbd-6ab1-44a4-827b-0f3947967bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.591836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85edbd-6ab1-44a4-827b-0f3947967bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.592471 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85edbd-6ab1-44a4-827b-0f3947967bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:37.593131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cf465-80a0-4658-88ed-dcec8eacbf79 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.593416 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cf465-80a0-4658-88ed-dcec8eacbf79 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.593712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cf465-80a0-4658-88ed-dcec8eacbf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.595267 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85edbd-6ab1-44a4-827b-0f3947967bb1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:37.613768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0b9cf465-80a0-4658-88ed-dcec8eacbf79 None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:37.614966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0b9cf465-80a0-4658-88ed-dcec8eacbf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:37.649431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:37.670388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1195/2363] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:09:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:37.682628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cf465-80a0-4658-88ed-dcec8eacbf79 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:37.683942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0b9cf465-80a0-4658-88ed-dcec8eacbf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:37.711009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1169/2364] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:37 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:37.712409 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85edbd-6ab1-44a4-827b-0f3947967bb1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:37.756623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cf465-80a0-4658-88ed-dcec8eacbf79 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:37.758859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:37.776799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85edbd-6ab1-44a4-827b-0f3947967bb1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:37.781637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f1ce9-55d7-42a9-bcb4-0226479c8557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:37.784021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f1ce9-55d7-42a9-bcb4-0226479c8557 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.784021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f1ce9-55d7-42a9-bcb4-0226479c8557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.784021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f1ce9-55d7-42a9-bcb4-0226479c8557 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.784021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f1ce9-55d7-42a9-bcb4-0226479c8557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:37.785500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f1ce9-55d7-42a9-bcb4-0226479c8557 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:37.819287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5492-e1ef-42c0-aaef-29c6a8d6098d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:37.819852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5492-e1ef-42c0-aaef-29c6a8d6098d service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.820132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5492-e1ef-42c0-aaef-29c6a8d6098d service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.820405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5492-e1ef-42c0-aaef-29c6a8d6098d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.873499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1170/2365] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:37 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:37.876899 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f1ce9-55d7-42a9-bcb4-0226479c8557 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:37.887687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f1ce9-55d7-42a9-bcb4-0226479c8557 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:37.888929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5492-e1ef-42c0-aaef-29c6a8d6098d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:37.890550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5492-e1ef-42c0-aaef-29c6a8d6098d service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:37.894552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0900134-c83e-49c6-9345-76aacfb660d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:37.895751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0900134-c83e-49c6-9345-76aacfb660d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.897605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0900134-c83e-49c6-9345-76aacfb660d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.897605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0900134-c83e-49c6-9345-76aacfb660d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.897605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0900134-c83e-49c6-9345-76aacfb660d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:37.899157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0900134-c83e-49c6-9345-76aacfb660d5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:37.901199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1196/2366] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:09:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:09:37.912799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1171/2367] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:37.917014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5492-e1ef-42c0-aaef-29c6a8d6098d service swift] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:37.927595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5492-e1ef-42c0-aaef-29c6a8d6098d service swift] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:37.932187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d6333-e5ed-4d07-b6ac-59154a823075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:37.933004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d6333-e5ed-4d07-b6ac-59154a823075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:37.933278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d6333-e5ed-4d07-b6ac-59154a823075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:37.933573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d6333-e5ed-4d07-b6ac-59154a823075 admin admin] PATH_INFO: `/v3/projects/0099ec35430643cd953d732295463daf/users/ef8366c665624984820ed314b52e7ad2/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:37.949762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d6333-e5ed-4d07-b6ac-59154a823075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0099ec35430643cd953d732295463daf, user_id=ef8366c665624984820ed314b52e7ad2, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:37.952481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d6333-e5ed-4d07-b6ac-59154a823075 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:38.042342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1197/2368] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:37 2022] PUT /identity/v3/projects/0099ec35430643cd953d732295463daf/users/ef8366c665624984820ed314b52e7ad2/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:38.046316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0900134-c83e-49c6-9345-76aacfb660d5 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:38.057736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0900134-c83e-49c6-9345-76aacfb660d5 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:38.121070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fb94e-8576-4489-9fc3-36111581c1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:38.121845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb94e-8576-4489-9fc3-36111581c1fe admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:38.122118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb94e-8576-4489-9fc3-36111581c1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:38.122392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fb94e-8576-4489-9fc3-36111581c1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:38.123174 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fb94e-8576-4489-9fc3-36111581c1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:38.124796 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fb94e-8576-4489-9fc3-36111581c1fe admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:38.139049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1172/2369] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:38.144091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d6333-e5ed-4d07-b6ac-59154a823075 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:38.152499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:38.156900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d6333-e5ed-4d07-b6ac-59154a823075 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:38.164841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400fb41-8cf3-4c9a-8795-841601458664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:38.165739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400fb41-8cf3-4c9a-8795-841601458664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:38.166060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400fb41-8cf3-4c9a-8795-841601458664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:38.166431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400fb41-8cf3-4c9a-8795-841601458664 admin admin] PATH_INFO: `/v3/projects/0099ec35430643cd953d732295463daf/users/ef8366c665624984820ed314b52e7ad2/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:38.168802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400fb41-8cf3-4c9a-8795-841601458664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0099ec35430643cd953d732295463daf, user_id=ef8366c665624984820ed314b52e7ad2, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:38.172772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400fb41-8cf3-4c9a-8795-841601458664 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:38.187029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1198/2370] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:38 2022] PUT /identity/v3/projects/0099ec35430643cd953d732295463daf/users/ef8366c665624984820ed314b52e7ad2/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:38.200244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498e9d0-d70e-416e-8fc0-02eafe004c33 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:38.200833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498e9d0-d70e-416e-8fc0-02eafe004c33 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:38.201334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498e9d0-d70e-416e-8fc0-02eafe004c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:38.236710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6498e9d0-d70e-416e-8fc0-02eafe004c33 None None] MFA Rules not processed for user `ef8366c665624984820ed314b52e7ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:38.238052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6498e9d0-d70e-416e-8fc0-02eafe004c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:38.366113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1173/2371] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:38.373852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400fb41-8cf3-4c9a-8795-841601458664 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:38.376513 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6400fb41-8cf3-4c9a-8795-841601458664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:38.448751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400fb41-8cf3-4c9a-8795-841601458664 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:38.452754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2693ad-949d-4628-af1e-3733feb81e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:38.453373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2693ad-949d-4628-af1e-3733feb81e3b service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:38.454398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2693ad-949d-4628-af1e-3733feb81e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:38.454671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2693ad-949d-4628-af1e-3733feb81e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:38.466119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2693ad-949d-4628-af1e-3733feb81e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:38.467817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2693ad-949d-4628-af1e-3733feb81e3b service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:38.490018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1199/2372] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:38.737444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498e9d0-d70e-416e-8fc0-02eafe004c33 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:38.754975 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498e9d0-d70e-416e-8fc0-02eafe004c33 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:38.761087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7fe76-1c67-4ec5-8e7b-d1bb8910f21a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:38.762313 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7fe76-1c67-4ec5-8e7b-d1bb8910f21a service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:38.762779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7fe76-1c67-4ec5-8e7b-d1bb8910f21a service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:38.763311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7fe76-1c67-4ec5-8e7b-d1bb8910f21a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:38.810098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:38.827046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7fe76-1c67-4ec5-8e7b-d1bb8910f21a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:38.828535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7fe76-1c67-4ec5-8e7b-d1bb8910f21a service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:38.838732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1174/2373] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:43.958804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2693ad-949d-4628-af1e-3733feb81e3b service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.960174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2a2693ad-949d-4628-af1e-3733feb81e3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:44.082512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2693ad-949d-4628-af1e-3733feb81e3b service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.089434 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2792678-3c0f-41bb-8e8c-8ab831674f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.090291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2792678-3c0f-41bb-8e8c-8ab831674f1a service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.090670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2792678-3c0f-41bb-8e8c-8ab831674f1a service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.091088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2792678-3c0f-41bb-8e8c-8ab831674f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.093538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d2792678-3c0f-41bb-8e8c-8ab831674f1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:44.190439 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2792678-3c0f-41bb-8e8c-8ab831674f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.192144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2792678-3c0f-41bb-8e8c-8ab831674f1a service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.202167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1200/2374] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:48.604744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7fe76-1c67-4ec5-8e7b-d1bb8910f21a service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:48.668184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7fe76-1c67-4ec5-8e7b-d1bb8910f21a service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:48.672684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:48.673301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.673621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.673919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] PATH_INFO: `/v3/users/0a0feb8063644777b3fc3248d460eb5d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.675145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0feb8063644777b3fc3248d460eb5d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:48.677127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:48.896300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0feb8063644777b3fc3248d460eb5d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.903204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0feb8063644777b3fc3248d460eb5d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.903941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0feb8063644777b3fc3248d460eb5d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.904545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0feb8063644777b3fc3248d460eb5d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.950716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0feb8063644777b3fc3248d460eb5d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.968737 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1175/2375] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:48 2022] DELETE /identity/v3/users/0a0feb8063644777b3fc3248d460eb5d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:48.973406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b72bf9-c2bc-463b-929d-b5f809d5e53c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.973927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b72bf9-c2bc-463b-929d-b5f809d5e53c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.974055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b72bf9-c2bc-463b-929d-b5f809d5e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.994419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-29b72bf9-c2bc-463b-929d-b5f809d5e53c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:48.995969 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-29b72bf9-c2bc-463b-929d-b5f809d5e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:49.025737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:49.058165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1201/2376] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:49.068559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.070052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:49.130387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a105783-bf4b-4f53-b48d-7b1aa0c8329a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.133937 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e3aca-c90e-4036-8c57-75cb549dcc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.134538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e3aca-c90e-4036-8c57-75cb549dcc2b service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.134816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e3aca-c90e-4036-8c57-75cb549dcc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.135089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e3aca-c90e-4036-8c57-75cb549dcc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.144899 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e3aca-c90e-4036-8c57-75cb549dcc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.147027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e3aca-c90e-4036-8c57-75cb549dcc2b service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.155842 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1176/2377] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:49.621988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b72bf9-c2bc-463b-929d-b5f809d5e53c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.629953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-29b72bf9-c2bc-463b-929d-b5f809d5e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:49.636539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b72bf9-c2bc-463b-929d-b5f809d5e53c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.641525 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.642162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.643009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.643321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] PATH_INFO: `/v3/projects/fa9f8980506d41148c159938915cd8ec` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.645282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9f8980506d41148c159938915cd8ec)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.647472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.800209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9f8980506d41148c159938915cd8ec', 'request_id': 'req-593f6fcf-3cb6-421e-a4ad-f52604eec723'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.805789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9f8980506d41148c159938915cd8ec', 'request_id': 'req-593f6fcf-3cb6-421e-a4ad-f52604eec723'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.811978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9f8980506d41148c159938915cd8ec', 'request_id': 'req-593f6fcf-3cb6-421e-a4ad-f52604eec723'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.891105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] The token cache is being invalidate because project fa9f8980506d41148c159938915cd8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:49.891414 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.892222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.896714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1202/2378] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:49 2022] DELETE /identity/v3/projects/fa9f8980506d41148c159938915cd8ec => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:49.900770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e3aca-c90e-4036-8c57-75cb549dcc2b service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.905782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:49.910892 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e3aca-c90e-4036-8c57-75cb549dcc2b service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.970969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.971173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.971345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.971604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] PATH_INFO: `/v3/users/ef8366c665624984820ed314b52e7ad2` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.972855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8366c665624984820ed314b52e7ad2)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.974798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:50.141553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8366c665624984820ed314b52e7ad2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.148291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8366c665624984820ed314b52e7ad2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.148945 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8366c665624984820ed314b52e7ad2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.149627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8366c665624984820ed314b52e7ad2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.242352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6807fbba-4f6c-401d-a065-eb827650f43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8366c665624984820ed314b52e7ad2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.261713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1177/2379] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:49 2022] DELETE /identity/v3/users/ef8366c665624984820ed314b52e7ad2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:50.695941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:50.697721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:50.714437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f6fcf-3cb6-421e-a4ad-f52604eec723 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:50.773743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:50.774373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:50.774641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:50.774907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] PATH_INFO: `/v3/projects/0099ec35430643cd953d732295463daf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:50.776003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0099ec35430643cd953d732295463daf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:50.777917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:50.865829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0099ec35430643cd953d732295463daf', 'request_id': 'req-50f23dc8-cc5e-488c-91f2-b4c095497037'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.870850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:50.872100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0099ec35430643cd953d732295463daf', 'request_id': 'req-50f23dc8-cc5e-488c-91f2-b4c095497037'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.879828 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0099ec35430643cd953d732295463daf', 'request_id': 'req-50f23dc8-cc5e-488c-91f2-b4c095497037'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.955275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] The token cache is being invalidate because project 0099ec35430643cd953d732295463daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:50.955573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.956837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-50f23dc8-cc5e-488c-91f2-b4c095497037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.963274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1203/2380] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:50 2022] DELETE /identity/v3/projects/0099ec35430643cd953d732295463daf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:50.965540 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d09450-c03e-4cf0-bb73-9dc8dd5cf685 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:50.966006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d09450-c03e-4cf0-bb73-9dc8dd5cf685 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:50.966116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d09450-c03e-4cf0-bb73-9dc8dd5cf685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.003693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-66d09450-c03e-4cf0-bb73-9dc8dd5cf685 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:51.005744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-66d09450-c03e-4cf0-bb73-9dc8dd5cf685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:51.070085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1178/2381] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:51.078922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae37a-5c93-428c-bc07-f2ed3adef2f6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.079201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae37a-5c93-428c-bc07-f2ed3adef2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.079471 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ae37a-5c93-428c-bc07-f2ed3adef2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.100545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b83ae37a-5c93-428c-bc07-f2ed3adef2f6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:51.101802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b83ae37a-5c93-428c-bc07-f2ed3adef2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:51.116222 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1204/2382] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:51.120241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d09450-c03e-4cf0-bb73-9dc8dd5cf685 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.135253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d09450-c03e-4cf0-bb73-9dc8dd5cf685 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.140546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b590815-6264-4981-b6a3-a13924bae720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.141299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590815-6264-4981-b6a3-a13924bae720 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.141677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590815-6264-4981-b6a3-a13924bae720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.142023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590815-6264-4981-b6a3-a13924bae720 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.143435 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b590815-6264-4981-b6a3-a13924bae720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:51.143803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b590815-6264-4981-b6a3-a13924bae720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.145449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b590815-6264-4981-b6a3-a13924bae720 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.160362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1179/2383] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:09:51.164718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae37a-5c93-428c-bc07-f2ed3adef2f6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.174365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ae37a-5c93-428c-bc07-f2ed3adef2f6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.179714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ba9ab-5c46-46d9-abf3-9aaaa6859ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.183273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ba9ab-5c46-46d9-abf3-9aaaa6859ceb admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.183273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ba9ab-5c46-46d9-abf3-9aaaa6859ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.183273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ba9ab-5c46-46d9-abf3-9aaaa6859ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.183273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ba9ab-5c46-46d9-abf3-9aaaa6859ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.183778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ba9ab-5c46-46d9-abf3-9aaaa6859ceb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.273989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1205/2384] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:51 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:51.278208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b590815-6264-4981-b6a3-a13924bae720 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.288675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b590815-6264-4981-b6a3-a13924bae720 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.293544 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:51.344914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aab28c-0768-452e-bf7c-3a1c5a54a03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.345599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aab28c-0768-452e-bf7c-3a1c5a54a03e admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.345877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aab28c-0768-452e-bf7c-3a1c5a54a03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.346288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aab28c-0768-452e-bf7c-3a1c5a54a03e admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.346939 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aab28c-0768-452e-bf7c-3a1c5a54a03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.348825 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aab28c-0768-452e-bf7c-3a1c5a54a03e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.454052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1180/2385] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:51 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:51.458441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ba9ab-5c46-46d9-abf3-9aaaa6859ceb admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.470438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ba9ab-5c46-46d9-abf3-9aaaa6859ceb admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.475566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c4470-d27a-4b71-a721-aceafd85e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.476176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c4470-d27a-4b71-a721-aceafd85e64c admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.476459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c4470-d27a-4b71-a721-aceafd85e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.476858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c4470-d27a-4b71-a721-aceafd85e64c admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.477544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c4470-d27a-4b71-a721-aceafd85e64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.479167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c4470-d27a-4b71-a721-aceafd85e64c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.493751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1206/2386] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:51.504197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aab28c-0768-452e-bf7c-3a1c5a54a03e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.514618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aab28c-0768-452e-bf7c-3a1c5a54a03e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.519678 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3c031-bef6-452d-b0e0-e8e9861908de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.520348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c031-bef6-452d-b0e0-e8e9861908de admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.520815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c031-bef6-452d-b0e0-e8e9861908de admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.521309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c031-bef6-452d-b0e0-e8e9861908de admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.522051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3c031-bef6-452d-b0e0-e8e9861908de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.523730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3c031-bef6-452d-b0e0-e8e9861908de admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.535559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1181/2387] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:51.539817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c4470-d27a-4b71-a721-aceafd85e64c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.550683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c4470-d27a-4b71-a721-aceafd85e64c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.555913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f42097-11f1-4846-8a30-5939afcd70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.556596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f42097-11f1-4846-8a30-5939afcd70f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.557484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f42097-11f1-4846-8a30-5939afcd70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.557769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f42097-11f1-4846-8a30-5939afcd70f3 admin admin] PATH_INFO: `/v3/projects/19b122e126e64fa18f71a63b36c342e8/users/a8954d0d2f4f4401971253149a0ad0b0/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.575483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f42097-11f1-4846-8a30-5939afcd70f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b122e126e64fa18f71a63b36c342e8, user_id=a8954d0d2f4f4401971253149a0ad0b0, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.578260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f42097-11f1-4846-8a30-5939afcd70f3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.670697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1207/2388] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:51 2022] PUT /identity/v3/projects/19b122e126e64fa18f71a63b36c342e8/users/a8954d0d2f4f4401971253149a0ad0b0/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:51.681477 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059fb22-b06c-463d-a29f-da6b95476ebf None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.681789 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059fb22-b06c-463d-a29f-da6b95476ebf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.682061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059fb22-b06c-463d-a29f-da6b95476ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.711390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5059fb22-b06c-463d-a29f-da6b95476ebf None None] MFA Rules not processed for user `a8954d0d2f4f4401971253149a0ad0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:51.712596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5059fb22-b06c-463d-a29f-da6b95476ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:51.780645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1182/2389] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:51.785913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f42097-11f1-4846-8a30-5939afcd70f3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.847911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f42097-11f1-4846-8a30-5939afcd70f3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.852726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dad4b-4841-4035-895e-c1811406826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.853325 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dad4b-4841-4035-895e-c1811406826e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.853641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dad4b-4841-4035-895e-c1811406826e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.853932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dad4b-4841-4035-895e-c1811406826e admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.854543 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dad4b-4841-4035-895e-c1811406826e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.856563 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dad4b-4841-4035-895e-c1811406826e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.946235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1208/2390] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:51 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:51.950337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059fb22-b06c-463d-a29f-da6b95476ebf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.961522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059fb22-b06c-463d-a29f-da6b95476ebf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.029281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85220-57d0-424a-9a0d-de7e0e51a3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.029281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85220-57d0-424a-9a0d-de7e0e51a3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.030001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85220-57d0-424a-9a0d-de7e0e51a3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.030001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85220-57d0-424a-9a0d-de7e0e51a3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.031186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85220-57d0-424a-9a0d-de7e0e51a3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.035323 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85220-57d0-424a-9a0d-de7e0e51a3b2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.935466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1183/2391] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:51 2022] POST /identity/v3/users => generated 292 bytes in 986 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:52.940451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dad4b-4841-4035-895e-c1811406826e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.951155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dad4b-4841-4035-895e-c1811406826e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.964337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7bb14-d10a-40e2-b3a4-2ab1cd24205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.965265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7bb14-d10a-40e2-b3a4-2ab1cd24205e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.965576 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7bb14-d10a-40e2-b3a4-2ab1cd24205e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.965864 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7bb14-d10a-40e2-b3a4-2ab1cd24205e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.966568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7bb14-d10a-40e2-b3a4-2ab1cd24205e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.968320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7bb14-d10a-40e2-b3a4-2ab1cd24205e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.980866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1209/2392] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:52.985116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85220-57d0-424a-9a0d-de7e0e51a3b2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.004940 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85220-57d0-424a-9a0d-de7e0e51a3b2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.025446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ce4b-6e2b-4047-aa37-d6b77ac35aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.026176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ce4b-6e2b-4047-aa37-d6b77ac35aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.026480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ce4b-6e2b-4047-aa37-d6b77ac35aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.026750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ce4b-6e2b-4047-aa37-d6b77ac35aa1 admin admin] PATH_INFO: `/v3/projects/d358a2e5d9a043fdb865e9b49aee3675/users/7058e06831c84d959b9b50b0b5dd6c1d/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.029386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:53.044693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219ce4b-6e2b-4047-aa37-d6b77ac35aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d358a2e5d9a043fdb865e9b49aee3675, user_id=7058e06831c84d959b9b50b0b5dd6c1d, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.047967 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219ce4b-6e2b-4047-aa37-d6b77ac35aa1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.200407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1184/2393] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:52 2022] PUT /identity/v3/projects/d358a2e5d9a043fdb865e9b49aee3675/users/7058e06831c84d959b9b50b0b5dd6c1d/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:53.204064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7bb14-d10a-40e2-b3a4-2ab1cd24205e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.214705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7bb14-d10a-40e2-b3a4-2ab1cd24205e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.271914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:53.279508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157c154-c54c-43ed-acad-4e6dca90055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.280124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157c154-c54c-43ed-acad-4e6dca90055b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.280429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157c154-c54c-43ed-acad-4e6dca90055b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.280730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157c154-c54c-43ed-acad-4e6dca90055b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.281380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157c154-c54c-43ed-acad-4e6dca90055b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.283536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157c154-c54c-43ed-acad-4e6dca90055b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.294492 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1210/2394] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:53.299751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ce4b-6e2b-4047-aa37-d6b77ac35aa1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.319000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ce4b-6e2b-4047-aa37-d6b77ac35aa1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.331349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b02184-9a3e-443d-b0ae-ee01414304e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.332003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b02184-9a3e-443d-b0ae-ee01414304e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.332260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b02184-9a3e-443d-b0ae-ee01414304e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.332568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b02184-9a3e-443d-b0ae-ee01414304e1 admin admin] PATH_INFO: `/v3/projects/d358a2e5d9a043fdb865e9b49aee3675/users/7058e06831c84d959b9b50b0b5dd6c1d/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.334531 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b02184-9a3e-443d-b0ae-ee01414304e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d358a2e5d9a043fdb865e9b49aee3675, user_id=7058e06831c84d959b9b50b0b5dd6c1d, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.337185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b02184-9a3e-443d-b0ae-ee01414304e1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.348660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1185/2395] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:53 2022] PUT /identity/v3/projects/d358a2e5d9a043fdb865e9b49aee3675/users/7058e06831c84d959b9b50b0b5dd6c1d/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:53.358856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c73b33-14e1-4e9f-abd2-131a10156106 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.361667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c73b33-14e1-4e9f-abd2-131a10156106 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.361667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c73b33-14e1-4e9f-abd2-131a10156106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.388823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-90c73b33-14e1-4e9f-abd2-131a10156106 None None] MFA Rules not processed for user `7058e06831c84d959b9b50b0b5dd6c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:53.390060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-90c73b33-14e1-4e9f-abd2-131a10156106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.462751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1211/2396] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:53.477061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b02184-9a3e-443d-b0ae-ee01414304e1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.481638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c6b02184-9a3e-443d-b0ae-ee01414304e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.540481 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b02184-9a3e-443d-b0ae-ee01414304e1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.544153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e956e6b-3267-490a-afad-5faf9c22041c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.544802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956e6b-3267-490a-afad-5faf9c22041c service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.545081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956e6b-3267-490a-afad-5faf9c22041c service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.545349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956e6b-3267-490a-afad-5faf9c22041c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.555814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e956e6b-3267-490a-afad-5faf9c22041c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.557258 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e956e6b-3267-490a-afad-5faf9c22041c service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.569764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1186/2397] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:54.642748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c73b33-14e1-4e9f-abd2-131a10156106 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.720402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c73b33-14e1-4e9f-abd2-131a10156106 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.725749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.726453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.726818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.727154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] PATH_INFO: `/v3/users/a8954d0d2f4f4401971253149a0ad0b0` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.728365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8954d0d2f4f4401971253149a0ad0b0)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.730302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.912635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8954d0d2f4f4401971253149a0ad0b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.913256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8954d0d2f4f4401971253149a0ad0b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.913875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8954d0d2f4f4401971253149a0ad0b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.007770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8954d0d2f4f4401971253149a0ad0b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.020943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8954d0d2f4f4401971253149a0ad0b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.026508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:55.034271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1212/2398] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:54 2022] DELETE /identity/v3/users/a8954d0d2f4f4401971253149a0ad0b0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:55.038871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869ecc8-43d5-4d85-8ea2-8f78cd435a81 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.039353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869ecc8-43d5-4d85-8ea2-8f78cd435a81 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.039464 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869ecc8-43d5-4d85-8ea2-8f78cd435a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.058197 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c869ecc8-43d5-4d85-8ea2-8f78cd435a81 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:55.063270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c869ecc8-43d5-4d85-8ea2-8f78cd435a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.118515 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1187/2399] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:55.129125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.130551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.188594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8f502-3ab1-4a34-9490-bf978e3cc0c3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.193231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af217-407e-4c0e-a528-236ce0e2df7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.193875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af217-407e-4c0e-a528-236ce0e2df7b service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.194174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af217-407e-4c0e-a528-236ce0e2df7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.199546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af217-407e-4c0e-a528-236ce0e2df7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.203558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29af217-407e-4c0e-a528-236ce0e2df7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.205000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29af217-407e-4c0e-a528-236ce0e2df7b service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.214495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1213/2400] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:55.292745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645708-8dfd-434e-84d3-1e93a5e2957c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.293023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645708-8dfd-434e-84d3-1e93a5e2957c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.293287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645708-8dfd-434e-84d3-1e93a5e2957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.313576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-94645708-8dfd-434e-84d3-1e93a5e2957c None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:55.315073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-94645708-8dfd-434e-84d3-1e93a5e2957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.372817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1188/2401] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 08:09:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:55.385570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af217-407e-4c0e-a528-236ce0e2df7b service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.386962 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e29af217-407e-4c0e-a528-236ce0e2df7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.460286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af217-407e-4c0e-a528-236ce0e2df7b service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.465446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75675838-1bbe-4eff-a811-203d184d09e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.466087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675838-1bbe-4eff-a811-203d184d09e8 service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.466356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675838-1bbe-4eff-a811-203d184d09e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.466624 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75675838-1bbe-4eff-a811-203d184d09e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.475749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75675838-1bbe-4eff-a811-203d184d09e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.477336 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75675838-1bbe-4eff-a811-203d184d09e8 service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.485917 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1214/2402] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:09:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:09:55.759209 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645708-8dfd-434e-84d3-1e93a5e2957c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.760794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-94645708-8dfd-434e-84d3-1e93a5e2957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.787253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94645708-8dfd-434e-84d3-1e93a5e2957c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.796066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.796804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.797350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.797736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] PATH_INFO: `/v3/projects/19b122e126e64fa18f71a63b36c342e8` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.799105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b122e126e64fa18f71a63b36c342e8)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.801836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.824894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:55.940918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b122e126e64fa18f71a63b36c342e8', 'request_id': 'req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.946995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b122e126e64fa18f71a63b36c342e8', 'request_id': 'req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.954337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b122e126e64fa18f71a63b36c342e8', 'request_id': 'req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.031918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] The token cache is being invalidate because project 19b122e126e64fa18f71a63b36c342e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:56.036219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.036219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.036219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1189/2403] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:55 2022] DELETE /identity/v3/projects/19b122e126e64fa18f71a63b36c342e8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:56.039743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75675838-1bbe-4eff-a811-203d184d09e8 service swift] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.054850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75675838-1bbe-4eff-a811-203d184d09e8 service swift] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.124049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.124845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.125189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.125552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] PATH_INFO: `/v3/users/7058e06831c84d959b9b50b0b5dd6c1d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.126807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7058e06831c84d959b9b50b0b5dd6c1d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.129577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.271687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:56.285857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7058e06831c84d959b9b50b0b5dd6c1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.286652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7058e06831c84d959b9b50b0b5dd6c1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.287337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7058e06831c84d959b9b50b0b5dd6c1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.351403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7058e06831c84d959b9b50b0b5dd6c1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.371607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7af6bb92-8913-485f-86f5-28dc2323fcf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7058e06831c84d959b9b50b0b5dd6c1d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.396163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1215/2404] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:56 2022] DELETE /identity/v3/users/7058e06831c84d959b9b50b0b5dd6c1d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:56.878432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.880057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.901279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53740cf-2031-4b8b-9e21-0a3ca88d4e81 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.972041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.972694 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.972969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.973240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] PATH_INFO: `/v3/projects/d358a2e5d9a043fdb865e9b49aee3675` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.974419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d358a2e5d9a043fdb865e9b49aee3675)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.976323 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.081890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd358a2e5d9a043fdb865e9b49aee3675', 'request_id': 'req-95850062-50d8-4ecc-bb5e-c4407d4466e3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:57.089443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd358a2e5d9a043fdb865e9b49aee3675', 'request_id': 'req-95850062-50d8-4ecc-bb5e-c4407d4466e3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:57.101020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd358a2e5d9a043fdb865e9b49aee3675', 'request_id': 'req-95850062-50d8-4ecc-bb5e-c4407d4466e3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:57.172627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] The token cache is being invalidate because project d358a2e5d9a043fdb865e9b49aee3675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:57.173145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:57.173814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-95850062-50d8-4ecc-bb5e-c4407d4466e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:57.176479 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1190/2405] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:56 2022] DELETE /identity/v3/projects/d358a2e5d9a043fdb865e9b49aee3675 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:57.181328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50877b-6f7b-4ca2-bc49-60d3d19010ed None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.181861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50877b-6f7b-4ca2-bc49-60d3d19010ed None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.181976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50877b-6f7b-4ca2-bc49-60d3d19010ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.203618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8c50877b-6f7b-4ca2-bc49-60d3d19010ed None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:57.204848 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8c50877b-6f7b-4ca2-bc49-60d3d19010ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:57.269004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1216/2406] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:57.276940 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a4dbc-415b-43d9-8e12-0f3cffc5dc2a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.277249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a4dbc-415b-43d9-8e12-0f3cffc5dc2a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.277552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a4dbc-415b-43d9-8e12-0f3cffc5dc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.298309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-607a4dbc-415b-43d9-8e12-0f3cffc5dc2a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:57.299296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-607a4dbc-415b-43d9-8e12-0f3cffc5dc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:57.307131 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1191/2407] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:57.311653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50877b-6f7b-4ca2-bc49-60d3d19010ed None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.324504 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50877b-6f7b-4ca2-bc49-60d3d19010ed None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.329602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dffca-665e-4852-b08d-26b13cfbebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.330309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dffca-665e-4852-b08d-26b13cfbebed admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.331487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dffca-665e-4852-b08d-26b13cfbebed admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.331762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dffca-665e-4852-b08d-26b13cfbebed admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.332478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dffca-665e-4852-b08d-26b13cfbebed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:57.332715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dffca-665e-4852-b08d-26b13cfbebed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.334329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dffca-665e-4852-b08d-26b13cfbebed admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.346930 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1217/2408] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:57.354630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a4dbc-415b-43d9-8e12-0f3cffc5dc2a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.360871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a4dbc-415b-43d9-8e12-0f3cffc5dc2a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.365731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a4d6a-eb5c-400d-8163-8f6f4d82c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.366346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a4d6a-eb5c-400d-8163-8f6f4d82c905 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.366621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a4d6a-eb5c-400d-8163-8f6f4d82c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.366867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a4d6a-eb5c-400d-8163-8f6f4d82c905 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.367492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a4d6a-eb5c-400d-8163-8f6f4d82c905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.369689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a4d6a-eb5c-400d-8163-8f6f4d82c905 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.493903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1192/2409] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:57.498008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dffca-665e-4852-b08d-26b13cfbebed admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.509025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dffca-665e-4852-b08d-26b13cfbebed admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.565830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694344c-c6c6-421a-9136-6d5125cdfcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.566431 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694344c-c6c6-421a-9136-6d5125cdfcbe admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.566754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694344c-c6c6-421a-9136-6d5125cdfcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.567023 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694344c-c6c6-421a-9136-6d5125cdfcbe admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.567633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694344c-c6c6-421a-9136-6d5125cdfcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.569545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694344c-c6c6-421a-9136-6d5125cdfcbe admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.659804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1218/2410] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:57.663665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a4d6a-eb5c-400d-8163-8f6f4d82c905 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.668992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:57.674868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a4d6a-eb5c-400d-8163-8f6f4d82c905 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.679494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf371c-36d3-432d-830f-65efb5a351d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.680120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf371c-36d3-432d-830f-65efb5a351d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.680392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf371c-36d3-432d-830f-65efb5a351d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.680658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf371c-36d3-432d-830f-65efb5a351d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.681290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf371c-36d3-432d-830f-65efb5a351d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.682980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf371c-36d3-432d-830f-65efb5a351d6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.693595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1193/2411] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:57.697411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694344c-c6c6-421a-9136-6d5125cdfcbe admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.707676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694344c-c6c6-421a-9136-6d5125cdfcbe admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.712533 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a029e8-eb8c-4b83-b5ad-d8146d0b30de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.713165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a029e8-eb8c-4b83-b5ad-d8146d0b30de admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.713446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a029e8-eb8c-4b83-b5ad-d8146d0b30de admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.713800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a029e8-eb8c-4b83-b5ad-d8146d0b30de admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.714456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a029e8-eb8c-4b83-b5ad-d8146d0b30de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.716060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a029e8-eb8c-4b83-b5ad-d8146d0b30de admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.727082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1219/2412] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:57.731331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf371c-36d3-432d-830f-65efb5a351d6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.741771 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf371c-36d3-432d-830f-65efb5a351d6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.746602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58248d4-2e4c-4947-a05f-afb499c9da70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.747234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58248d4-2e4c-4947-a05f-afb499c9da70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.747506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58248d4-2e4c-4947-a05f-afb499c9da70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.747775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58248d4-2e4c-4947-a05f-afb499c9da70 admin admin] PATH_INFO: `/v3/projects/973e8cf4a9154022ae220064caedc26c/users/20bdc47294f94d46a2df9294cbd9e3da/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.762611 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58248d4-2e4c-4947-a05f-afb499c9da70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973e8cf4a9154022ae220064caedc26c, user_id=20bdc47294f94d46a2df9294cbd9e3da, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.765232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58248d4-2e4c-4947-a05f-afb499c9da70 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.848529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1194/2413] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:57 2022] PUT /identity/v3/projects/973e8cf4a9154022ae220064caedc26c/users/20bdc47294f94d46a2df9294cbd9e3da/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:57.858909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49563c99-8ccd-40f6-83f9-bb2088eb5efe None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.859191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49563c99-8ccd-40f6-83f9-bb2088eb5efe None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.859466 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49563c99-8ccd-40f6-83f9-bb2088eb5efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.885254 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:57.890950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-49563c99-8ccd-40f6-83f9-bb2088eb5efe None None] MFA Rules not processed for user `20bdc47294f94d46a2df9294cbd9e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:57.892195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-49563c99-8ccd-40f6-83f9-bb2088eb5efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:57.956320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1220/2414] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:57.965905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58248d4-2e4c-4947-a05f-afb499c9da70 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.027100 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58248d4-2e4c-4947-a05f-afb499c9da70 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.031778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc31b7-ece7-44fa-a583-4ce2a0459885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.032384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc31b7-ece7-44fa-a583-4ce2a0459885 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.032660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc31b7-ece7-44fa-a583-4ce2a0459885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.032926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc31b7-ece7-44fa-a583-4ce2a0459885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.034212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc31b7-ece7-44fa-a583-4ce2a0459885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.036395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc31b7-ece7-44fa-a583-4ce2a0459885 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.141228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1195/2415] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:58.149660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49563c99-8ccd-40f6-83f9-bb2088eb5efe None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.157811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49563c99-8ccd-40f6-83f9-bb2088eb5efe None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.219058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01366a-dfa9-419b-8138-867d856548ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.219707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01366a-dfa9-419b-8138-867d856548ad admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.219860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01366a-dfa9-419b-8138-867d856548ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.220137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01366a-dfa9-419b-8138-867d856548ad admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.220763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01366a-dfa9-419b-8138-867d856548ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.223500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01366a-dfa9-419b-8138-867d856548ad admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.305321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1221/2416] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:58 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:58.309388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc31b7-ece7-44fa-a583-4ce2a0459885 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.320096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc31b7-ece7-44fa-a583-4ce2a0459885 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.325066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4782a-0237-4cab-a409-f7cbdf478393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.325689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4782a-0237-4cab-a409-f7cbdf478393 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.325966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4782a-0237-4cab-a409-f7cbdf478393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.326344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4782a-0237-4cab-a409-f7cbdf478393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.326990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4782a-0237-4cab-a409-f7cbdf478393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.328586 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4782a-0237-4cab-a409-f7cbdf478393 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.340327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1196/2417] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:58.344593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01366a-dfa9-419b-8138-867d856548ad admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.355418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01366a-dfa9-419b-8138-867d856548ad admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.360027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965ade-ccdd-447f-99b6-d0211e911f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.360715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965ade-ccdd-447f-99b6-d0211e911f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.361002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965ade-ccdd-447f-99b6-d0211e911f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.361272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965ade-ccdd-447f-99b6-d0211e911f3e admin admin] PATH_INFO: `/v3/projects/1ea291c4c8914493b63a3f5cb98e6da7/users/af51b9f9372e416189297d08be05e9b2/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.376746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00965ade-ccdd-447f-99b6-d0211e911f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea291c4c8914493b63a3f5cb98e6da7, user_id=af51b9f9372e416189297d08be05e9b2, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.379457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00965ade-ccdd-447f-99b6-d0211e911f3e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.431301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1222/2418] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:58 2022] PUT /identity/v3/projects/1ea291c4c8914493b63a3f5cb98e6da7/users/af51b9f9372e416189297d08be05e9b2/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:58.435721 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4782a-0237-4cab-a409-f7cbdf478393 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.446643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4782a-0237-4cab-a409-f7cbdf478393 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.509411 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f315a-12d7-43be-ac78-742b887c2568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.510059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f315a-12d7-43be-ac78-742b887c2568 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.516207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f315a-12d7-43be-ac78-742b887c2568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.516207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f315a-12d7-43be-ac78-742b887c2568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.516207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f315a-12d7-43be-ac78-742b887c2568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.516207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f315a-12d7-43be-ac78-742b887c2568 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.523971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1197/2419] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:58.528132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965ade-ccdd-447f-99b6-d0211e911f3e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.538771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965ade-ccdd-447f-99b6-d0211e911f3e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.543360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569f31e-aac2-4b75-a867-1ebdc1e4824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.544000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569f31e-aac2-4b75-a867-1ebdc1e4824c admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.544278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569f31e-aac2-4b75-a867-1ebdc1e4824c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.544683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569f31e-aac2-4b75-a867-1ebdc1e4824c admin admin] PATH_INFO: `/v3/projects/1ea291c4c8914493b63a3f5cb98e6da7/users/af51b9f9372e416189297d08be05e9b2/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.546662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569f31e-aac2-4b75-a867-1ebdc1e4824c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea291c4c8914493b63a3f5cb98e6da7, user_id=af51b9f9372e416189297d08be05e9b2, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.549376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569f31e-aac2-4b75-a867-1ebdc1e4824c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.560204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1223/2420] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:58 2022] PUT /identity/v3/projects/1ea291c4c8914493b63a3f5cb98e6da7/users/af51b9f9372e416189297d08be05e9b2/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:58.629070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2d232-9abf-48f7-b522-40ab99d8a804 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.629354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2d232-9abf-48f7-b522-40ab99d8a804 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.629688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2d232-9abf-48f7-b522-40ab99d8a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.660203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-98c2d232-9abf-48f7-b522-40ab99d8a804 None None] MFA Rules not processed for user `af51b9f9372e416189297d08be05e9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:58.661428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-98c2d232-9abf-48f7-b522-40ab99d8a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:58.689169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:58.734340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1198/2421] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:09:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:58.746413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569f31e-aac2-4b75-a867-1ebdc1e4824c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.748209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4569f31e-aac2-4b75-a867-1ebdc1e4824c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:58.808624 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569f31e-aac2-4b75-a867-1ebdc1e4824c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.812815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5bfc7-e267-45fe-8615-0208ad7834ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.813451 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5bfc7-e267-45fe-8615-0208ad7834ba service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.813817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5bfc7-e267-45fe-8615-0208ad7834ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.814124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5bfc7-e267-45fe-8615-0208ad7834ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.823909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:58.874239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5bfc7-e267-45fe-8615-0208ad7834ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.875679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5bfc7-e267-45fe-8615-0208ad7834ba service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.885854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1224/2422] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:00.547089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2d232-9abf-48f7-b522-40ab99d8a804 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:00.548493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-98c2d232-9abf-48f7-b522-40ab99d8a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:00.560841 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2d232-9abf-48f7-b522-40ab99d8a804 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:00.564539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f0a2e-0402-43ee-8473-3f785ae18651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:00.565285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f0a2e-0402-43ee-8473-3f785ae18651 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:00.565591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f0a2e-0402-43ee-8473-3f785ae18651 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:00.565865 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f0a2e-0402-43ee-8473-3f785ae18651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:00.574810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f0a2e-0402-43ee-8473-3f785ae18651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:00.576231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f0a2e-0402-43ee-8473-3f785ae18651 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:00.586379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1199/2423] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:05.053537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5bfc7-e267-45fe-8615-0208ad7834ba service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:05.116205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5bfc7-e267-45fe-8615-0208ad7834ba service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:05.120989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:05.121650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:05.121929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:05.122201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] PATH_INFO: `/v3/users/20bdc47294f94d46a2df9294cbd9e3da` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:05.123321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20bdc47294f94d46a2df9294cbd9e3da)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:05.125241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:05.338730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20bdc47294f94d46a2df9294cbd9e3da'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.339395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20bdc47294f94d46a2df9294cbd9e3da'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.339996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20bdc47294f94d46a2df9294cbd9e3da'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.434399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20bdc47294f94d46a2df9294cbd9e3da'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.448553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20bdc47294f94d46a2df9294cbd9e3da'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.460497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1225/2424] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:05 2022] DELETE /identity/v3/users/20bdc47294f94d46a2df9294cbd9e3da => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:05.464953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f3822-b487-4569-9165-ad85e040ae04 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:05.465420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f3822-b487-4569-9165-ad85e040ae04 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:05.465558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f3822-b487-4569-9165-ad85e040ae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:05.485486 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4f6f3822-b487-4569-9165-ad85e040ae04 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:05.487434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4f6f3822-b487-4569-9165-ad85e040ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:05.543422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1200/2425] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:05.553677 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:05.555083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:05.586083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:05.613117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16ad89-e958-48d6-881f-bd2147ba22d8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:05.616882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7add-fb9b-4d22-be96-0b2f88f00764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:05.617989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7add-fb9b-4d22-be96-0b2f88f00764 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:05.618644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7add-fb9b-4d22-be96-0b2f88f00764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:05.619062 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7add-fb9b-4d22-be96-0b2f88f00764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:05.628198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b7add-fb9b-4d22-be96-0b2f88f00764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:05.629657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b7add-fb9b-4d22-be96-0b2f88f00764 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:05.639359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1226/2426] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:06.394881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f3822-b487-4569-9165-ad85e040ae04 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:06.396465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4f6f3822-b487-4569-9165-ad85e040ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:06.408419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f3822-b487-4569-9165-ad85e040ae04 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:06.413378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:06.414181 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:06.414349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:06.414620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] PATH_INFO: `/v3/projects/973e8cf4a9154022ae220064caedc26c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:06.415906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=973e8cf4a9154022ae220064caedc26c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:06.417871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:06.561021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973e8cf4a9154022ae220064caedc26c', 'request_id': 'req-0fa5235d-1a20-4403-9acd-ff1b5892df0e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.569924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973e8cf4a9154022ae220064caedc26c', 'request_id': 'req-0fa5235d-1a20-4403-9acd-ff1b5892df0e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.576872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973e8cf4a9154022ae220064caedc26c', 'request_id': 'req-0fa5235d-1a20-4403-9acd-ff1b5892df0e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.659422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] The token cache is being invalidate because project 973e8cf4a9154022ae220064caedc26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:06.659755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.660406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.661971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1201/2427] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:06 2022] DELETE /identity/v3/projects/973e8cf4a9154022ae220064caedc26c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:06.666206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7add-fb9b-4d22-be96-0b2f88f00764 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:06.676776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7add-fb9b-4d22-be96-0b2f88f00764 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:06.740769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:06.741596 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:06.742256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:06.742256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] PATH_INFO: `/v3/users/af51b9f9372e416189297d08be05e9b2` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:06.743501 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af51b9f9372e416189297d08be05e9b2)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:06.745613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:06.925816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af51b9f9372e416189297d08be05e9b2'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.926461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af51b9f9372e416189297d08be05e9b2'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.927068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af51b9f9372e416189297d08be05e9b2'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.013648 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af51b9f9372e416189297d08be05e9b2'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.026782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9535321d-a2fa-476c-996a-4ea1062684f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af51b9f9372e416189297d08be05e9b2'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.039756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1227/2428] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:06 2022] DELETE /identity/v3/users/af51b9f9372e416189297d08be05e9b2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:07.449089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.450662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.467808 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5235d-1a20-4403-9acd-ff1b5892df0e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.500305 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:07.527731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.528371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.528632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.528903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] PATH_INFO: `/v3/projects/1ea291c4c8914493b63a3f5cb98e6da7` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.530040 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea291c4c8914493b63a3f5cb98e6da7)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.531928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.634981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea291c4c8914493b63a3f5cb98e6da7', 'request_id': 'req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.640482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea291c4c8914493b63a3f5cb98e6da7', 'request_id': 'req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.647097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea291c4c8914493b63a3f5cb98e6da7', 'request_id': 'req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.759954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] The token cache is being invalidate because project 1ea291c4c8914493b63a3f5cb98e6da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:07.760243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.760859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8ea93b0c-eff1-4022-88a5-73c52e4d20ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.762430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1202/2429] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:07 2022] DELETE /identity/v3/projects/1ea291c4c8914493b63a3f5cb98e6da7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:07.767375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd2f7e-4852-4d0f-a1a3-383efe98a651 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.768481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd2f7e-4852-4d0f-a1a3-383efe98a651 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.769127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd2f7e-4852-4d0f-a1a3-383efe98a651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.788826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2acd2f7e-4852-4d0f-a1a3-383efe98a651 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:07.790071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2acd2f7e-4852-4d0f-a1a3-383efe98a651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.838656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:07.852740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1228/2430] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:07.860511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d96489-1f50-42c8-9d9c-c036ce28c757 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.860795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d96489-1f50-42c8-9d9c-c036ce28c757 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.861067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d96489-1f50-42c8-9d9c-c036ce28c757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.882731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a6d96489-1f50-42c8-9d9c-c036ce28c757 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:07.883953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a6d96489-1f50-42c8-9d9c-c036ce28c757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.891854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1203/2431] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:07.897245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd2f7e-4852-4d0f-a1a3-383efe98a651 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.907189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd2f7e-4852-4d0f-a1a3-383efe98a651 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.911842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc480d-1ec7-4701-860c-655cd5e855bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.912441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc480d-1ec7-4701-860c-655cd5e855bb admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.912738 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc480d-1ec7-4701-860c-655cd5e855bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.913007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc480d-1ec7-4701-860c-655cd5e855bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.913683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc480d-1ec7-4701-860c-655cd5e855bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:07.913981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc480d-1ec7-4701-860c-655cd5e855bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.915567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc480d-1ec7-4701-860c-655cd5e855bb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.929542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1229/2432] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:07.938332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d96489-1f50-42c8-9d9c-c036ce28c757 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.948403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d96489-1f50-42c8-9d9c-c036ce28c757 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.953375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316244e-421b-4654-a41e-a06acda27488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.954010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316244e-421b-4654-a41e-a06acda27488 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.954288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316244e-421b-4654-a41e-a06acda27488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.954558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316244e-421b-4654-a41e-a06acda27488 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.955317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316244e-421b-4654-a41e-a06acda27488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.962240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316244e-421b-4654-a41e-a06acda27488 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.043269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1204/2433] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:08.047590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc480d-1ec7-4701-860c-655cd5e855bb admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.058749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc480d-1ec7-4701-860c-655cd5e855bb admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.114764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87131511-4e4f-412d-b529-024cfa3ca007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.115364 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131511-4e4f-412d-b529-024cfa3ca007 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.115636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131511-4e4f-412d-b529-024cfa3ca007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.115902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131511-4e4f-412d-b529-024cfa3ca007 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.116515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87131511-4e4f-412d-b529-024cfa3ca007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.118778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87131511-4e4f-412d-b529-024cfa3ca007 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.188550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1230/2434] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:08.190421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316244e-421b-4654-a41e-a06acda27488 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.201188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316244e-421b-4654-a41e-a06acda27488 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.206195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5a8c-dadb-49f9-a300-cd7303b495dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.206815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5a8c-dadb-49f9-a300-cd7303b495dc admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.207072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5a8c-dadb-49f9-a300-cd7303b495dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.207338 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5a8c-dadb-49f9-a300-cd7303b495dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.207979 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a5a8c-dadb-49f9-a300-cd7303b495dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.209597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a5a8c-dadb-49f9-a300-cd7303b495dc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.222629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1205/2435] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:08.225904 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87131511-4e4f-412d-b529-024cfa3ca007 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.239229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87131511-4e4f-412d-b529-024cfa3ca007 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.244157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535686e-6704-4799-96a7-526348b1ee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.244757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535686e-6704-4799-96a7-526348b1ee45 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.245034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535686e-6704-4799-96a7-526348b1ee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.245337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535686e-6704-4799-96a7-526348b1ee45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.246012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535686e-6704-4799-96a7-526348b1ee45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.247599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535686e-6704-4799-96a7-526348b1ee45 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.259086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1231/2436] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:08.267810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5a8c-dadb-49f9-a300-cd7303b495dc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.279867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5a8c-dadb-49f9-a300-cd7303b495dc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.285379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c01c6-b71e-4c1f-9038-a815d424ecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.286060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c01c6-b71e-4c1f-9038-a815d424ecf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.286334 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c01c6-b71e-4c1f-9038-a815d424ecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.286604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c01c6-b71e-4c1f-9038-a815d424ecf7 admin admin] PATH_INFO: `/v3/projects/e1fa6571bec34bd3a85f52858da94ea7/users/c06013c6fff84db7a8682a12417364fc/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.302021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c01c6-b71e-4c1f-9038-a815d424ecf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fa6571bec34bd3a85f52858da94ea7, user_id=c06013c6fff84db7a8682a12417364fc, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.305062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c01c6-b71e-4c1f-9038-a815d424ecf7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.423093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1206/2437] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:08 2022] PUT /identity/v3/projects/e1fa6571bec34bd3a85f52858da94ea7/users/c06013c6fff84db7a8682a12417364fc/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:08.433968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a879d-f25c-434e-8fa0-248babdf01f5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.434257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a879d-f25c-434e-8fa0-248babdf01f5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.434572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a879d-f25c-434e-8fa0-248babdf01f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.461965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ca9a879d-f25c-434e-8fa0-248babdf01f5 None None] MFA Rules not processed for user `c06013c6fff84db7a8682a12417364fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:08.463248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ca9a879d-f25c-434e-8fa0-248babdf01f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:08.536415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1232/2438] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:08.544921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c01c6-b71e-4c1f-9038-a815d424ecf7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.609900 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c01c6-b71e-4c1f-9038-a815d424ecf7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.615218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dd1ce-4c4b-41dc-b5c4-721bd65aeb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.615842 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dd1ce-4c4b-41dc-b5c4-721bd65aeb75 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.616389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dd1ce-4c4b-41dc-b5c4-721bd65aeb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.616657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dd1ce-4c4b-41dc-b5c4-721bd65aeb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.617278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70dd1ce-4c4b-41dc-b5c4-721bd65aeb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.619462 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70dd1ce-4c4b-41dc-b5c4-721bd65aeb75 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.623980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:08.717319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1207/2439] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:08.722389 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a879d-f25c-434e-8fa0-248babdf01f5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.733283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a879d-f25c-434e-8fa0-248babdf01f5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.780161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:08.793807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005156-3c80-45c0-90cb-1a3a91fe061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.794437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005156-3c80-45c0-90cb-1a3a91fe061f admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.794721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005156-3c80-45c0-90cb-1a3a91fe061f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.795213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005156-3c80-45c0-90cb-1a3a91fe061f admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.795862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2005156-3c80-45c0-90cb-1a3a91fe061f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.797938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2005156-3c80-45c0-90cb-1a3a91fe061f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.942785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1233/2440] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:08.944233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dd1ce-4c4b-41dc-b5c4-721bd65aeb75 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.954565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dd1ce-4c4b-41dc-b5c4-721bd65aeb75 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.959673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae67094-9ba1-46a5-9371-7076fa157d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.960966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae67094-9ba1-46a5-9371-7076fa157d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.960966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae67094-9ba1-46a5-9371-7076fa157d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.960966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae67094-9ba1-46a5-9371-7076fa157d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.961544 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae67094-9ba1-46a5-9371-7076fa157d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.965750 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae67094-9ba1-46a5-9371-7076fa157d03 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.978343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1208/2441] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:08.982601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005156-3c80-45c0-90cb-1a3a91fe061f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.993450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005156-3c80-45c0-90cb-1a3a91fe061f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.998802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ac0aa-f979-4065-8924-e19cf9487d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.999740 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac0aa-f979-4065-8924-e19cf9487d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.000177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac0aa-f979-4065-8924-e19cf9487d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.000840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac0aa-f979-4065-8924-e19cf9487d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.001673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ac0aa-f979-4065-8924-e19cf9487d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.003915 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ac0aa-f979-4065-8924-e19cf9487d31 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.015467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1234/2442] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:09.020079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae67094-9ba1-46a5-9371-7076fa157d03 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.031763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae67094-9ba1-46a5-9371-7076fa157d03 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.037134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58980-b284-4477-8e06-64274690232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.037847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58980-b284-4477-8e06-64274690232d admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.038127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58980-b284-4477-8e06-64274690232d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.038429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58980-b284-4477-8e06-64274690232d admin admin] PATH_INFO: `/v3/projects/0f70c5dd440a4664adaea28b42b7f4f1/users/325ccbea70f44e45b051a680e1043a3d/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.054242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb58980-b284-4477-8e06-64274690232d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f70c5dd440a4664adaea28b42b7f4f1, user_id=325ccbea70f44e45b051a680e1043a3d, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.057155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb58980-b284-4477-8e06-64274690232d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.118316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1209/2443] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:09 2022] PUT /identity/v3/projects/0f70c5dd440a4664adaea28b42b7f4f1/users/325ccbea70f44e45b051a680e1043a3d/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:09.130595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5ada-bdb1-45a0-8d67-eee1538ed292 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.131134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5ada-bdb1-45a0-8d67-eee1538ed292 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.131587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5ada-bdb1-45a0-8d67-eee1538ed292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.162836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5caa5ada-bdb1-45a0-8d67-eee1538ed292 None None] MFA Rules not processed for user `325ccbea70f44e45b051a680e1043a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:09.164459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5caa5ada-bdb1-45a0-8d67-eee1538ed292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:09.232999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1235/2444] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:09.240489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58980-b284-4477-8e06-64274690232d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.310497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58980-b284-4477-8e06-64274690232d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.315809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fd13a-6a82-46df-97bf-9854eb6ded46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.316415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fd13a-6a82-46df-97bf-9854eb6ded46 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.316690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fd13a-6a82-46df-97bf-9854eb6ded46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.319085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fd13a-6a82-46df-97bf-9854eb6ded46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.319085 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fd13a-6a82-46df-97bf-9854eb6ded46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.319571 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fd13a-6a82-46df-97bf-9854eb6ded46 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.430547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1210/2445] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:09 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:09.434689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5ada-bdb1-45a0-8d67-eee1538ed292 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.446095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5ada-bdb1-45a0-8d67-eee1538ed292 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.510467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762535-9da6-4d19-a104-0531c6851d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.511085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762535-9da6-4d19-a104-0531c6851d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.511389 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762535-9da6-4d19-a104-0531c6851d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.511662 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762535-9da6-4d19-a104-0531c6851d6d admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.512303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9762535-9da6-4d19-a104-0531c6851d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.514272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9762535-9da6-4d19-a104-0531c6851d6d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.603716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1236/2446] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:09 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:09.615957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fd13a-6a82-46df-97bf-9854eb6ded46 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.638076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fd13a-6a82-46df-97bf-9854eb6ded46 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.643591 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a71d8-2bca-4eb3-b89f-873bfc4cb4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.644310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a71d8-2bca-4eb3-b89f-873bfc4cb4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.644673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a71d8-2bca-4eb3-b89f-873bfc4cb4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.645005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a71d8-2bca-4eb3-b89f-873bfc4cb4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.647802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a71d8-2bca-4eb3-b89f-873bfc4cb4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.652993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a71d8-2bca-4eb3-b89f-873bfc4cb4f7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.670690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1211/2447] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:09.676083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762535-9da6-4d19-a104-0531c6851d6d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.691509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762535-9da6-4d19-a104-0531c6851d6d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.698655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2b88-30c6-4b15-96e9-d96d28561190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.699617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2b88-30c6-4b15-96e9-d96d28561190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.699957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2b88-30c6-4b15-96e9-d96d28561190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.700294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2b88-30c6-4b15-96e9-d96d28561190 admin admin] PATH_INFO: `/v3/projects/f6b43ee47bfb4242b45df7acab69dad5/users/67e47eb2947e4656bcc063d062885197/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.728403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2b88-30c6-4b15-96e9-d96d28561190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b43ee47bfb4242b45df7acab69dad5, user_id=67e47eb2947e4656bcc063d062885197, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.732245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2b88-30c6-4b15-96e9-d96d28561190 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.827952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1237/2448] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:09 2022] PUT /identity/v3/projects/f6b43ee47bfb4242b45df7acab69dad5/users/67e47eb2947e4656bcc063d062885197/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:09.837244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a71d8-2bca-4eb3-b89f-873bfc4cb4f7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.844284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a71d8-2bca-4eb3-b89f-873bfc4cb4f7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.919633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3bd01-572e-4ef1-a002-a9ae65204bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.920804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3bd01-572e-4ef1-a002-a9ae65204bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.920804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3bd01-572e-4ef1-a002-a9ae65204bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.921057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3bd01-572e-4ef1-a002-a9ae65204bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.921974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3bd01-572e-4ef1-a002-a9ae65204bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.924511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3bd01-572e-4ef1-a002-a9ae65204bfb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.937923 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1212/2449] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:09.942083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2b88-30c6-4b15-96e9-d96d28561190 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.954317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2b88-30c6-4b15-96e9-d96d28561190 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.960297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c47421-29ff-4fc5-baff-2f66bb3efb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.961280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c47421-29ff-4fc5-baff-2f66bb3efb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.961845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c47421-29ff-4fc5-baff-2f66bb3efb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.962127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c47421-29ff-4fc5-baff-2f66bb3efb63 admin admin] PATH_INFO: `/v3/projects/f6b43ee47bfb4242b45df7acab69dad5/users/67e47eb2947e4656bcc063d062885197/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.964499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c47421-29ff-4fc5-baff-2f66bb3efb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b43ee47bfb4242b45df7acab69dad5, user_id=67e47eb2947e4656bcc063d062885197, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.967395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c47421-29ff-4fc5-baff-2f66bb3efb63 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.997388 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1238/2450] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:09 2022] PUT /identity/v3/projects/f6b43ee47bfb4242b45df7acab69dad5/users/67e47eb2947e4656bcc063d062885197/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:09.998751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a2229-b313-4b61-9d73-99a7bb35292e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.999037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a2229-b313-4b61-9d73-99a7bb35292e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.999314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a2229-b313-4b61-9d73-99a7bb35292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:10.045716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a01a2229-b313-4b61-9d73-99a7bb35292e None None] MFA Rules not processed for user `67e47eb2947e4656bcc063d062885197`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:10.047696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a01a2229-b313-4b61-9d73-99a7bb35292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:10.059231 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:10.123491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1213/2451] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:10.135497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c47421-29ff-4fc5-baff-2f66bb3efb63 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:10.137362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d5c47421-29ff-4fc5-baff-2f66bb3efb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:10.148212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:10.201497 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c47421-29ff-4fc5-baff-2f66bb3efb63 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:10.207033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbfd45-61eb-4e3e-9a5e-053d5dfb7a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:10.207653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbfd45-61eb-4e3e-9a5e-053d5dfb7a0a service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:10.207933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbfd45-61eb-4e3e-9a5e-053d5dfb7a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:10.208203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbfd45-61eb-4e3e-9a5e-053d5dfb7a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:10.219610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbfd45-61eb-4e3e-9a5e-053d5dfb7a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:10.221947 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbfd45-61eb-4e3e-9a5e-053d5dfb7a0a service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:10.234295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1239/2452] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:11.135465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a2229-b313-4b61-9d73-99a7bb35292e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:11.136880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a01a2229-b313-4b61-9d73-99a7bb35292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:11.193402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a2229-b313-4b61-9d73-99a7bb35292e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:11.196986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:11.197609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:11.197884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:11.198150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:11.199844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:11.266065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:11.267486 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:11.277405 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1214/2453] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:11.389927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbfd45-61eb-4e3e-9a5e-053d5dfb7a0a service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:11.391323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-25cbfd45-61eb-4e3e-9a5e-053d5dfb7a0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:11.402639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbfd45-61eb-4e3e-9a5e-053d5dfb7a0a service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:11.407804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9976e3-4c03-4d4f-af28-c6e9d0737939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:11.408404 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9976e3-4c03-4d4f-af28-c6e9d0737939 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:11.409226 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9976e3-4c03-4d4f-af28-c6e9d0737939 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:11.409518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9976e3-4c03-4d4f-af28-c6e9d0737939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:11.469216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9976e3-4c03-4d4f-af28-c6e9d0737939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:11.470781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9976e3-4c03-4d4f-af28-c6e9d0737939 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:11.480718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1240/2454] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:15.209319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:15.213241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:15.223539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9665bfd-1985-4b27-82a3-b018ac62e7bd service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:15.228109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:15.228756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.230436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.230436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] PATH_INFO: `/v3/users/9870363844644da7ad0a353f8ebfeffc` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.230436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9870363844644da7ad0a353f8ebfeffc)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:15.232346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:15.487983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9870363844644da7ad0a353f8ebfeffc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.490054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:15.495749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9870363844644da7ad0a353f8ebfeffc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.496420 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9870363844644da7ad0a353f8ebfeffc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.497036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9870363844644da7ad0a353f8ebfeffc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.582987 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-15ee317e-f56f-45bc-9599-a627e7d674c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9870363844644da7ad0a353f8ebfeffc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.602482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1215/2455] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:15 2022] DELETE /identity/v3/users/9870363844644da7ad0a353f8ebfeffc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:15.858266 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9976e3-4c03-4d4f-af28-c6e9d0737939 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:15.871437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9976e3-4c03-4d4f-af28-c6e9d0737939 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:15.938701 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:15.939360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.939814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.940087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] PATH_INFO: `/v3/projects/14b8c522fdf14a9fb1514148392598c5` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.941652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b8c522fdf14a9fb1514148392598c5)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:15.943673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.086114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b8c522fdf14a9fb1514148392598c5', 'request_id': 'req-da69cace-4638-4baa-a518-ee77a9118691'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:16.087313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:16.092252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b8c522fdf14a9fb1514148392598c5', 'request_id': 'req-da69cace-4638-4baa-a518-ee77a9118691'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:16.099869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b8c522fdf14a9fb1514148392598c5', 'request_id': 'req-da69cace-4638-4baa-a518-ee77a9118691'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:16.181822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] The token cache is being invalidate because project 14b8c522fdf14a9fb1514148392598c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:16.182106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:16.182715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-da69cace-4638-4baa-a518-ee77a9118691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:16.184192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1241/2456] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:15 2022] DELETE /identity/v3/projects/14b8c522fdf14a9fb1514148392598c5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:16.189224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaba9de-fb56-4fc4-98a1-8702e97c53e9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.189593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaba9de-fb56-4fc4-98a1-8702e97c53e9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.189866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaba9de-fb56-4fc4-98a1-8702e97c53e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.210461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4aaba9de-fb56-4fc4-98a1-8702e97c53e9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:16.211703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4aaba9de-fb56-4fc4-98a1-8702e97c53e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:16.272426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1216/2457] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:16.280376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b891f0-05f3-4fcc-91e0-fa79b2f1fef3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.280660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b891f0-05f3-4fcc-91e0-fa79b2f1fef3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.280933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b891f0-05f3-4fcc-91e0-fa79b2f1fef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.301355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-47b891f0-05f3-4fcc-91e0-fa79b2f1fef3 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:16.302618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-47b891f0-05f3-4fcc-91e0-fa79b2f1fef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:16.310787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1242/2458] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:16.315403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaba9de-fb56-4fc4-98a1-8702e97c53e9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.325757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaba9de-fb56-4fc4-98a1-8702e97c53e9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.330352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.330943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.331218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.332005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.332667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:16.332928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.334551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.346119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1217/2459] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:16.352165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b891f0-05f3-4fcc-91e0-fa79b2f1fef3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.364793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b891f0-05f3-4fcc-91e0-fa79b2f1fef3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.373781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee11703-b34d-4b78-9e96-3020952a8766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.374631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee11703-b34d-4b78-9e96-3020952a8766 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.374916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee11703-b34d-4b78-9e96-3020952a8766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.375183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee11703-b34d-4b78-9e96-3020952a8766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.375826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee11703-b34d-4b78-9e96-3020952a8766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.377977 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee11703-b34d-4b78-9e96-3020952a8766 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.454278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.462009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:16.479739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1243/2460] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:16 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:16.482657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee11703-b34d-4b78-9e96-3020952a8766 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.524526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f71237-8bc9-4758-9096-c8a4130cf64b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.561347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee11703-b34d-4b78-9e96-3020952a8766 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.567008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedff26-dee4-46f0-ae4f-de7040495cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.567734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedff26-dee4-46f0-ae4f-de7040495cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.568014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedff26-dee4-46f0-ae4f-de7040495cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.568270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedff26-dee4-46f0-ae4f-de7040495cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.568901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedff26-dee4-46f0-ae4f-de7040495cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.570976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedff26-dee4-46f0-ae4f-de7040495cc7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.577649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.583169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.583169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.583169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.583169 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:16.593319 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.594850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.604565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1218/2461] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:16.698113 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.699541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:16.715925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1244/2462] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:16 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:16.716494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:16.717001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedff26-dee4-46f0-ae4f-de7040495cc7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.728465 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedff26-dee4-46f0-ae4f-de7040495cc7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.733424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7821-f5b2-4543-b5eb-2e1aa65c06ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.734138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7821-f5b2-4543-b5eb-2e1aa65c06ef admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.734686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7821-f5b2-4543-b5eb-2e1aa65c06ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.734686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce7821-f5b2-4543-b5eb-2e1aa65c06ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.735312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7821-f5b2-4543-b5eb-2e1aa65c06ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.736810 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce7821-f5b2-4543-b5eb-2e1aa65c06ef admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.748626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1245/2463] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:16.753014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7821-f5b2-4543-b5eb-2e1aa65c06ef admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.767678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce7821-f5b2-4543-b5eb-2e1aa65c06ef admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.767876 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812f40d-b7f5-490f-bbba-3f0de1789416 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.772214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab67c2-5162-42c4-9e88-c2e17970510a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.772818 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab67c2-5162-42c4-9e88-c2e17970510a service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.773101 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab67c2-5162-42c4-9e88-c2e17970510a service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.773375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab67c2-5162-42c4-9e88-c2e17970510a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.775020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20885c82-a62f-42dc-8685-45bfad584715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.775646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20885c82-a62f-42dc-8685-45bfad584715 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.775944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20885c82-a62f-42dc-8685-45bfad584715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.776212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20885c82-a62f-42dc-8685-45bfad584715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.776866 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20885c82-a62f-42dc-8685-45bfad584715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.778745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20885c82-a62f-42dc-8685-45bfad584715 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.778974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0dab67c2-5162-42c4-9e88-c2e17970510a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:16.797338 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1246/2464] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:16.799644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20885c82-a62f-42dc-8685-45bfad584715 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.813237 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20885c82-a62f-42dc-8685-45bfad584715 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.821031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb6ab-7ef3-41b5-abd2-2ffecbcadbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.821723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb6ab-7ef3-41b5-abd2-2ffecbcadbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.821998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb6ab-7ef3-41b5-abd2-2ffecbcadbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.822335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb6ab-7ef3-41b5-abd2-2ffecbcadbbc admin admin] PATH_INFO: `/v3/projects/7c73b9e44304446284bdd34f4305e1fd/users/4f77f0cf3a9d4e51a0317f610be4a8a6/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.839966 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfb6ab-7ef3-41b5-abd2-2ffecbcadbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c73b9e44304446284bdd34f4305e1fd, user_id=4f77f0cf3a9d4e51a0317f610be4a8a6, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.843546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfb6ab-7ef3-41b5-abd2-2ffecbcadbbc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.853926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab67c2-5162-42c4-9e88-c2e17970510a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.862509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab67c2-5162-42c4-9e88-c2e17970510a service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.865027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1219/2465] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:16.961374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1247/2466] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:16 2022] PUT /identity/v3/projects/7c73b9e44304446284bdd34f4305e1fd/users/4f77f0cf3a9d4e51a0317f610be4a8a6/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:16.963116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f344b-9410-4a9b-b10e-7bbf2e85d10f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.963397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f344b-9410-4a9b-b10e-7bbf2e85d10f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.963666 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f344b-9410-4a9b-b10e-7bbf2e85d10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.992543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-245f344b-9410-4a9b-b10e-7bbf2e85d10f None None] MFA Rules not processed for user `4f77f0cf3a9d4e51a0317f610be4a8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:16.993786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-245f344b-9410-4a9b-b10e-7bbf2e85d10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:17.065530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1220/2467] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:17.075473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb6ab-7ef3-41b5-abd2-2ffecbcadbbc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:17.077389 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-13cfb6ab-7ef3-41b5-abd2-2ffecbcadbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:17.133395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:17.155105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb6ab-7ef3-41b5-abd2-2ffecbcadbbc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:17.160936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7feb3-14e4-4508-90ca-81848de0257f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ef753445d864a0ab30ec970446b29cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:17.161585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7feb3-14e4-4508-90ca-81848de0257f service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:17.161867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7feb3-14e4-4508-90ca-81848de0257f service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:17.162140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7feb3-14e4-4508-90ca-81848de0257f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:17.170463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7feb3-14e4-4508-90ca-81848de0257f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:17.172125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7feb3-14e4-4508-90ca-81848de0257f service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:17.182010 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1248/2468] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:17.430805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f344b-9410-4a9b-b10e-7bbf2e85d10f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:17.491094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:17.495866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f344b-9410-4a9b-b10e-7bbf2e85d10f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:17.500323 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:17.500976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:17.501227 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:17.507208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] PATH_INFO: `/v3/users/4f77f0cf3a9d4e51a0317f610be4a8a6` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:17.507208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f77f0cf3a9d4e51a0317f610be4a8a6)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:17.507208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:17.703191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f77f0cf3a9d4e51a0317f610be4a8a6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.711370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f77f0cf3a9d4e51a0317f610be4a8a6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.712089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f77f0cf3a9d4e51a0317f610be4a8a6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.717421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f77f0cf3a9d4e51a0317f610be4a8a6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.819372 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f77f0cf3a9d4e51a0317f610be4a8a6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.850779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1221/2469] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:17 2022] DELETE /identity/v3/users/4f77f0cf3a9d4e51a0317f610be4a8a6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:17.855638 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c7f85-673c-4aaf-8b25-885360516904 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:17.855922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c7f85-673c-4aaf-8b25-885360516904 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:17.856253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c7f85-673c-4aaf-8b25-885360516904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:17.876975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f13c7f85-673c-4aaf-8b25-885360516904 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:17.878233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f13c7f85-673c-4aaf-8b25-885360516904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:17.943000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1249/2470] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:17.953488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:17.955833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:18.016380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1300ae2-a8f0-4491-988c-743dec608923 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:18.020947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86b31a-4626-4ba6-a853-ad061d0376d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:18.021441 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b31a-4626-4ba6-a853-ad061d0376d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:18.021746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b31a-4626-4ba6-a853-ad061d0376d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:18.022016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b31a-4626-4ba6-a853-ad061d0376d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:18.031404 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86b31a-4626-4ba6-a853-ad061d0376d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:18.032988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86b31a-4626-4ba6-a853-ad061d0376d0 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:18.043922 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1222/2471] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:18.678963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c7f85-673c-4aaf-8b25-885360516904 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:18.678963 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f13c7f85-673c-4aaf-8b25-885360516904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:18.707925 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c7f85-673c-4aaf-8b25-885360516904 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:18.714260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:18.715808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:18.716838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:18.717795 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] PATH_INFO: `/v3/projects/7c73b9e44304446284bdd34f4305e1fd` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:18.719285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c73b9e44304446284bdd34f4305e1fd)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:18.723478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:18.890199 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c73b9e44304446284bdd34f4305e1fd', 'request_id': 'req-0d5d1e2a-2a01-41f6-ae58-c512d7496703'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:18.896823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c73b9e44304446284bdd34f4305e1fd', 'request_id': 'req-0d5d1e2a-2a01-41f6-ae58-c512d7496703'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:18.903453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c73b9e44304446284bdd34f4305e1fd', 'request_id': 'req-0d5d1e2a-2a01-41f6-ae58-c512d7496703'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:18.990544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] The token cache is being invalidate because project 7c73b9e44304446284bdd34f4305e1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:18.990892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:18.991718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d5d1e2a-2a01-41f6-ae58-c512d7496703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:18.993540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1250/2472] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:18 2022] DELETE /identity/v3/projects/7c73b9e44304446284bdd34f4305e1fd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:18.998618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb54df3-5457-430c-bfc3-e58b97a0a4ce None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:18.999105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb54df3-5457-430c-bfc3-e58b97a0a4ce None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:18.999208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb54df3-5457-430c-bfc3-e58b97a0a4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.020954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7cb54df3-5457-430c-bfc3-e58b97a0a4ce None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:19.021675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7cb54df3-5457-430c-bfc3-e58b97a0a4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:19.081037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1223/2473] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:19.091039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57bb0b-e269-4475-91c3-f818c42e86ec None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.091319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57bb0b-e269-4475-91c3-f818c42e86ec None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.091590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57bb0b-e269-4475-91c3-f818c42e86ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.112566 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-3d57bb0b-e269-4475-91c3-f818c42e86ec None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:19.114870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3d57bb0b-e269-4475-91c3-f818c42e86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:19.123385 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1251/2474] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:19.127821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb54df3-5457-430c-bfc3-e58b97a0a4ce None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:19.139284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb54df3-5457-430c-bfc3-e58b97a0a4ce None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:19.148578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fa6ce-bf5a-4b4e-9d68-cb8448622fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:19.148578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fa6ce-bf5a-4b4e-9d68-cb8448622fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.148578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fa6ce-bf5a-4b4e-9d68-cb8448622fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.148578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fa6ce-bf5a-4b4e-9d68-cb8448622fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.148926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fa6ce-bf5a-4b4e-9d68-cb8448622fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:19.148926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fa6ce-bf5a-4b4e-9d68-cb8448622fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:19.149955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fa6ce-bf5a-4b4e-9d68-cb8448622fbb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:19.168855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1224/2475] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:19.179968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57bb0b-e269-4475-91c3-f818c42e86ec None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:19.197674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57bb0b-e269-4475-91c3-f818c42e86ec None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:19.204120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db00bb-9628-4ced-b1d7-c49b4369be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:19.204794 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db00bb-9628-4ced-b1d7-c49b4369be0a admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.205076 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db00bb-9628-4ced-b1d7-c49b4369be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.205529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db00bb-9628-4ced-b1d7-c49b4369be0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.206201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db00bb-9628-4ced-b1d7-c49b4369be0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:19.208660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db00bb-9628-4ced-b1d7-c49b4369be0a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:19.302783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1252/2476] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:19 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:19.307055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fa6ce-bf5a-4b4e-9d68-cb8448622fbb admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:19.323600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fa6ce-bf5a-4b4e-9d68-cb8448622fbb admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:19.329944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:19.391615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fc947-8d58-44ac-970b-957d75298e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:19.392245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fc947-8d58-44ac-970b-957d75298e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.392500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fc947-8d58-44ac-970b-957d75298e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.392769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fc947-8d58-44ac-970b-957d75298e45 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.393385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fc947-8d58-44ac-970b-957d75298e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:19.395635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fc947-8d58-44ac-970b-957d75298e45 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:19.498789 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1225/2477] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:19 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:19.505711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db00bb-9628-4ced-b1d7-c49b4369be0a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:19.516912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db00bb-9628-4ced-b1d7-c49b4369be0a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:19.521730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20793a-6688-4cca-9502-67a9e57de991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:19.522340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20793a-6688-4cca-9502-67a9e57de991 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.522621 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20793a-6688-4cca-9502-67a9e57de991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.522895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20793a-6688-4cca-9502-67a9e57de991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.523584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20793a-6688-4cca-9502-67a9e57de991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:19.525122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20793a-6688-4cca-9502-67a9e57de991 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:19.540062 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1253/2478] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:19.544262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fc947-8d58-44ac-970b-957d75298e45 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:19.555505 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fc947-8d58-44ac-970b-957d75298e45 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:19.561168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425f08b-f500-49f0-9e7c-d2ce46874056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:19.562205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425f08b-f500-49f0-9e7c-d2ce46874056 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.562205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425f08b-f500-49f0-9e7c-d2ce46874056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.568415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425f08b-f500-49f0-9e7c-d2ce46874056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.568415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425f08b-f500-49f0-9e7c-d2ce46874056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:19.568415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425f08b-f500-49f0-9e7c-d2ce46874056 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:19.576863 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1226/2479] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:19.581261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20793a-6688-4cca-9502-67a9e57de991 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:19.599601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20793a-6688-4cca-9502-67a9e57de991 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:19.604628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a087a-7228-4985-b80a-e733b9affac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:19.605672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a087a-7228-4985-b80a-e733b9affac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.605672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a087a-7228-4985-b80a-e733b9affac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.605914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a087a-7228-4985-b80a-e733b9affac2 admin admin] PATH_INFO: `/v3/projects/c13b3f6616f84c4d969a65e806afe66c/users/a8fef145a4704969b05e77a5f2d10fce/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.625373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a087a-7228-4985-b80a-e733b9affac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13b3f6616f84c4d969a65e806afe66c, user_id=a8fef145a4704969b05e77a5f2d10fce, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:19.628205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a087a-7228-4985-b80a-e733b9affac2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:19.741164 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:19.747565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1254/2480] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:19 2022] PUT /identity/v3/projects/c13b3f6616f84c4d969a65e806afe66c/users/a8fef145a4704969b05e77a5f2d10fce/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:19.759836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d483380-8a7e-4ada-8495-5654e67c1516 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.760146 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d483380-8a7e-4ada-8495-5654e67c1516 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.760382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d483380-8a7e-4ada-8495-5654e67c1516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.791581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5d483380-8a7e-4ada-8495-5654e67c1516 None None] MFA Rules not processed for user `a8fef145a4704969b05e77a5f2d10fce`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:19.792791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5d483380-8a7e-4ada-8495-5654e67c1516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:19.866465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1227/2481] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:19.870927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a087a-7228-4985-b80a-e733b9affac2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:19.969028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a087a-7228-4985-b80a-e733b9affac2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:19.980718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e58cb-773d-46bb-ae8a-be22cfa8465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:19.982609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e58cb-773d-46bb-ae8a-be22cfa8465e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.983019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e58cb-773d-46bb-ae8a-be22cfa8465e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.987413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e58cb-773d-46bb-ae8a-be22cfa8465e admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.987413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e58cb-773d-46bb-ae8a-be22cfa8465e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:19.988300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e58cb-773d-46bb-ae8a-be22cfa8465e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:20.134572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1255/2482] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:19 2022] POST /identity/v3/projects => generated 365 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:20.136638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d483380-8a7e-4ada-8495-5654e67c1516 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:20.149610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d483380-8a7e-4ada-8495-5654e67c1516 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:20.219002 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d17a3e-d3cf-486b-bfc1-9d368ea2bd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:20.220132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d17a3e-d3cf-486b-bfc1-9d368ea2bd23 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:20.220617 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d17a3e-d3cf-486b-bfc1-9d368ea2bd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:20.220895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d17a3e-d3cf-486b-bfc1-9d368ea2bd23 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:20.223260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d17a3e-d3cf-486b-bfc1-9d368ea2bd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:20.226299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d17a3e-d3cf-486b-bfc1-9d368ea2bd23 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:20.386568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1228/2483] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:20 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:20.391030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e58cb-773d-46bb-ae8a-be22cfa8465e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:20.407696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e58cb-773d-46bb-ae8a-be22cfa8465e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:20.415307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb826088-a336-4f41-b393-fd5ff491f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:20.416073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb826088-a336-4f41-b393-fd5ff491f376 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:20.416452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb826088-a336-4f41-b393-fd5ff491f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:20.416822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb826088-a336-4f41-b393-fd5ff491f376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:20.417947 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb826088-a336-4f41-b393-fd5ff491f376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:20.420646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb826088-a336-4f41-b393-fd5ff491f376 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:20.438044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1256/2484] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:20.443324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d17a3e-d3cf-486b-bfc1-9d368ea2bd23 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:20.450075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:20.454453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d17a3e-d3cf-486b-bfc1-9d368ea2bd23 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:20.459911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e0917-36c1-4eaf-b4c3-b69674c8a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:20.460697 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e0917-36c1-4eaf-b4c3-b69674c8a4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:20.461025 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e0917-36c1-4eaf-b4c3-b69674c8a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:20.461366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e0917-36c1-4eaf-b4c3-b69674c8a4c3 admin admin] PATH_INFO: `/v3/projects/41a97eef6de5485f85768a8741ddb60f/users/0f57c55d92a84424811611d63b59bc0a/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:20.476819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e0917-36c1-4eaf-b4c3-b69674c8a4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a97eef6de5485f85768a8741ddb60f, user_id=0f57c55d92a84424811611d63b59bc0a, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:20.479724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e0917-36c1-4eaf-b4c3-b69674c8a4c3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:20.577981 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1229/2485] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:20 2022] PUT /identity/v3/projects/41a97eef6de5485f85768a8741ddb60f/users/0f57c55d92a84424811611d63b59bc0a/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:20.582722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb826088-a336-4f41-b393-fd5ff491f376 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:20.594365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb826088-a336-4f41-b393-fd5ff491f376 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:20.655374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aced366-dfa9-421e-bff7-de638726f689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:20.655974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced366-dfa9-421e-bff7-de638726f689 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:20.656247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced366-dfa9-421e-bff7-de638726f689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:20.656550 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced366-dfa9-421e-bff7-de638726f689 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:20.657153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aced366-dfa9-421e-bff7-de638726f689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:20.658853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aced366-dfa9-421e-bff7-de638726f689 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:20.669230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1257/2486] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:20.673732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e0917-36c1-4eaf-b4c3-b69674c8a4c3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:20.685570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e0917-36c1-4eaf-b4c3-b69674c8a4c3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:20.690340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fc114-2dff-427b-82b8-f23eb46641b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:20.691695 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fc114-2dff-427b-82b8-f23eb46641b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:20.691967 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fc114-2dff-427b-82b8-f23eb46641b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:20.692232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fc114-2dff-427b-82b8-f23eb46641b2 admin admin] PATH_INFO: `/v3/projects/41a97eef6de5485f85768a8741ddb60f/users/0f57c55d92a84424811611d63b59bc0a/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:20.694155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fc114-2dff-427b-82b8-f23eb46641b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a97eef6de5485f85768a8741ddb60f, user_id=0f57c55d92a84424811611d63b59bc0a, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:20.696834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fc114-2dff-427b-82b8-f23eb46641b2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:20.707049 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1230/2487] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:20 2022] PUT /identity/v3/projects/41a97eef6de5485f85768a8741ddb60f/users/0f57c55d92a84424811611d63b59bc0a/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:20.718314 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab169d7-945e-4fb9-a444-db48f910adc2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:20.718609 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab169d7-945e-4fb9-a444-db48f910adc2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:20.718878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab169d7-945e-4fb9-a444-db48f910adc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:20.720774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fc114-2dff-427b-82b8-f23eb46641b2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:20.722547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5d8fc114-2dff-427b-82b8-f23eb46641b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:20.750456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-eab169d7-945e-4fb9-a444-db48f910adc2 None None] MFA Rules not processed for user `0f57c55d92a84424811611d63b59bc0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:20.751753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-eab169d7-945e-4fb9-a444-db48f910adc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:20.793341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fc114-2dff-427b-82b8-f23eb46641b2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:20.798302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:20.798810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:20.799084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:20.799353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] PATH_INFO: `/v3/users/f98b5c461b014fd6962da1b044afed9e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:20.801119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98b5c461b014fd6962da1b044afed9e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:20.803061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:20.811603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:20.823700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1258/2488] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:20.837858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab169d7-945e-4fb9-a444-db48f910adc2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:20.839245 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-eab169d7-945e-4fb9-a444-db48f910adc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:20.896116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab169d7-945e-4fb9-a444-db48f910adc2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:20.900001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f1d3e-169a-4fa9-acfc-c4473d2b47c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:20.900602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f1d3e-169a-4fa9-acfc-c4473d2b47c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:20.900880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f1d3e-169a-4fa9-acfc-c4473d2b47c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:20.901150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f1d3e-169a-4fa9-acfc-c4473d2b47c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:20.911152 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f1d3e-169a-4fa9-acfc-c4473d2b47c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:20.912961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f1d3e-169a-4fa9-acfc-c4473d2b47c8 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:20.924906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1259/2489] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:21.008225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98b5c461b014fd6962da1b044afed9e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.015189 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98b5c461b014fd6962da1b044afed9e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.015880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98b5c461b014fd6962da1b044afed9e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.016529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98b5c461b014fd6962da1b044afed9e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.093170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98b5c461b014fd6962da1b044afed9e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.111553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1231/2490] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:20 2022] DELETE /identity/v3/users/f98b5c461b014fd6962da1b044afed9e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:21.352106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f1d3e-169a-4fa9-acfc-c4473d2b47c8 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:21.364138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f1d3e-169a-4fa9-acfc-c4473d2b47c8 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:21.433069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:21.433741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.434017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.434475 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] PATH_INFO: `/v3/projects/758266e2ed4b4c0995aae938409ce499` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.435756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758266e2ed4b4c0995aae938409ce499)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:21.437711 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:21.536386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758266e2ed4b4c0995aae938409ce499', 'request_id': 'req-416cd871-0944-45e9-93a2-e6f1ff70f3e3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.543750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758266e2ed4b4c0995aae938409ce499', 'request_id': 'req-416cd871-0944-45e9-93a2-e6f1ff70f3e3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.559535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758266e2ed4b4c0995aae938409ce499', 'request_id': 'req-416cd871-0944-45e9-93a2-e6f1ff70f3e3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.601651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:21.603125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:21.617279 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867f729-acb9-4224-bcad-9c37fbec1a61 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:21.641708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] The token cache is being invalidate because project 758266e2ed4b4c0995aae938409ce499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:21.641993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.642637 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-416cd871-0944-45e9-93a2-e6f1ff70f3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.644190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1260/2491] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:21 2022] DELETE /identity/v3/projects/758266e2ed4b4c0995aae938409ce499 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:21.648984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f1bb8-ecb6-4e31-906e-d2947ba26782 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.649264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f1bb8-ecb6-4e31-906e-d2947ba26782 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.649618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f1bb8-ecb6-4e31-906e-d2947ba26782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.666074 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:21.670809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-da1f1bb8-ecb6-4e31-906e-d2947ba26782 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:21.672037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-da1f1bb8-ecb6-4e31-906e-d2947ba26782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:21.680223 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:21.680973 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.681355 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.681780 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] PATH_INFO: `/v3/users/c06013c6fff84db7a8682a12417364fc` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.682956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06013c6fff84db7a8682a12417364fc)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:21.684869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:21.694572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:21.738855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1261/2492] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:21.747077 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536eeaa-36e3-4b03-8e21-e4d68b6e667e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.747572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536eeaa-36e3-4b03-8e21-e4d68b6e667e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.747841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536eeaa-36e3-4b03-8e21-e4d68b6e667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.767502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5536eeaa-36e3-4b03-8e21-e4d68b6e667e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:21.768777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5536eeaa-36e3-4b03-8e21-e4d68b6e667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:21.777051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1262/2493] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:21.781134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536eeaa-36e3-4b03-8e21-e4d68b6e667e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:21.790838 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536eeaa-36e3-4b03-8e21-e4d68b6e667e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:21.795532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0359a1-dfa9-47b2-a0d0-884805cc82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:21.796111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0359a1-dfa9-47b2-a0d0-884805cc82a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.796395 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0359a1-dfa9-47b2-a0d0-884805cc82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.796665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0359a1-dfa9-47b2-a0d0-884805cc82a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.797301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0359a1-dfa9-47b2-a0d0-884805cc82a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:21.797633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0359a1-dfa9-47b2-a0d0-884805cc82a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:21.799234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0359a1-dfa9-47b2-a0d0-884805cc82a2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:21.816699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1263/2494] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:10:21.816699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0359a1-dfa9-47b2-a0d0-884805cc82a2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:21.827454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0359a1-dfa9-47b2-a0d0-884805cc82a2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:21.832507 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc130df9-0223-4c2e-9357-a809465ac296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:21.833150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc130df9-0223-4c2e-9357-a809465ac296 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.833434 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc130df9-0223-4c2e-9357-a809465ac296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.833890 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc130df9-0223-4c2e-9357-a809465ac296 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.834526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc130df9-0223-4c2e-9357-a809465ac296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:21.836254 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc130df9-0223-4c2e-9357-a809465ac296 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:21.946458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06013c6fff84db7a8682a12417364fc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.953232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06013c6fff84db7a8682a12417364fc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.954039 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06013c6fff84db7a8682a12417364fc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.954556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06013c6fff84db7a8682a12417364fc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.968551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1264/2495] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:21 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:21.969452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc130df9-0223-4c2e-9357-a809465ac296 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:21.971028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bc130df9-0223-4c2e-9357-a809465ac296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.033233 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc130df9-0223-4c2e-9357-a809465ac296 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.036371 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06013c6fff84db7a8682a12417364fc'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:22.038684 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.039262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.044200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.044200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] PATH_INFO: `/v3/users/a8fef145a4704969b05e77a5f2d10fce` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.044200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8fef145a4704969b05e77a5f2d10fce)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.044200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.056477 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1232/2496] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:21 2022] DELETE /identity/v3/users/c06013c6fff84db7a8682a12417364fc => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:22.057564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.059090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.123764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1b0d-bce2-4b0c-a103-675ee26cd564 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.128424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33e74f-91a8-4e68-8b1d-fbcb62789845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.129138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e74f-91a8-4e68-8b1d-fbcb62789845 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.129416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e74f-91a8-4e68-8b1d-fbcb62789845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.129729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33e74f-91a8-4e68-8b1d-fbcb62789845 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.130333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33e74f-91a8-4e68-8b1d-fbcb62789845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.132268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33e74f-91a8-4e68-8b1d-fbcb62789845 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.227282 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8fef145a4704969b05e77a5f2d10fce'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:22.227955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8fef145a4704969b05e77a5f2d10fce'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:22.228704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8fef145a4704969b05e77a5f2d10fce'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:22.242322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1233/2497] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:22 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:22.242322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183fe9-23cf-4a9b-879f-f874132bf310 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.244184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183fe9-23cf-4a9b-879f-f874132bf310 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.244468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183fe9-23cf-4a9b-879f-f874132bf310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.262634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-17183fe9-23cf-4a9b-879f-f874132bf310 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:22.263874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-17183fe9-23cf-4a9b-879f-f874132bf310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.272911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1234/2498] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:22.273942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183fe9-23cf-4a9b-879f-f874132bf310 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.275242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-17183fe9-23cf-4a9b-879f-f874132bf310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.287999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183fe9-23cf-4a9b-879f-f874132bf310 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.290854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8fef145a4704969b05e77a5f2d10fce'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:22.295034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd4c9e-3dfe-4ce3-9ce6-6578875320c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.295034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd4c9e-3dfe-4ce3-9ce6-6578875320c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.295034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd4c9e-3dfe-4ce3-9ce6-6578875320c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.295034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd4c9e-3dfe-4ce3-9ce6-6578875320c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.295572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd4c9e-3dfe-4ce3-9ce6-6578875320c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.296073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd4c9e-3dfe-4ce3-9ce6-6578875320c3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.304757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8fef145a4704969b05e77a5f2d10fce'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:22.306942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1235/2499] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:22.307747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd4c9e-3dfe-4ce3-9ce6-6578875320c3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.309407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-57cd4c9e-3dfe-4ce3-9ce6-6578875320c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.324029 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1265/2500] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:21 2022] DELETE /identity/v3/users/a8fef145a4704969b05e77a5f2d10fce => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:22.324936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.369570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd4c9e-3dfe-4ce3-9ce6-6578875320c3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.398529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556029ad-2d5d-42df-bdee-ea4e15925c5f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.400679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bab2ca-35f9-4876-bc19-114e6f249f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.401293 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab2ca-35f9-4876-bc19-114e6f249f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.401651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab2ca-35f9-4876-bc19-114e6f249f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.401928 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab2ca-35f9-4876-bc19-114e6f249f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.402582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bab2ca-35f9-4876-bc19-114e6f249f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.404340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bab2ca-35f9-4876-bc19-114e6f249f16 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.415695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1266/2501] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:22.416939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e83d8-91fc-48d4-b5fe-a849848f9572 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.417227 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e83d8-91fc-48d4-b5fe-a849848f9572 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.417618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e83d8-91fc-48d4-b5fe-a849848f9572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.418573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0f58a-f0eb-474f-a11c-cc2989e4a346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.419311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0f58a-f0eb-474f-a11c-cc2989e4a346 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.419595 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0f58a-f0eb-474f-a11c-cc2989e4a346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.419866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0f58a-f0eb-474f-a11c-cc2989e4a346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.429380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0f58a-f0eb-474f-a11c-cc2989e4a346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.431015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0f58a-f0eb-474f-a11c-cc2989e4a346 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.437610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-878e83d8-91fc-48d4-b5fe-a849848f9572 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:22.438869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-878e83d8-91fc-48d4-b5fe-a849848f9572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.441228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1236/2502] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:22.442330 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0f58a-f0eb-474f-a11c-cc2989e4a346 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.444214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:22.446836 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1267/2503] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:22.453681 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0f58a-f0eb-474f-a11c-cc2989e4a346 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.458857 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9465b1-ca33-4ecc-bc98-0a31dc30892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.459534 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9465b1-ca33-4ecc-bc98-0a31dc30892a admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.459812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9465b1-ca33-4ecc-bc98-0a31dc30892a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.460084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9465b1-ca33-4ecc-bc98-0a31dc30892a admin admin] PATH_INFO: `/v3/projects/89eb05a8f42347f3b05e5bbfa9f101c0/users/3cbe8eb76c51418d97f096dd73047cb8/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.462965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e83d8-91fc-48d4-b5fe-a849848f9572 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.470664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:22.475362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e83d8-91fc-48d4-b5fe-a849848f9572 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.485926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9465b1-ca33-4ecc-bc98-0a31dc30892a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89eb05a8f42347f3b05e5bbfa9f101c0, user_id=3cbe8eb76c51418d97f096dd73047cb8, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.485926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9465b1-ca33-4ecc-bc98-0a31dc30892a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.486160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023eec2-b7a7-4ea7-9f72-bac13a7c84b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.486160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023eec2-b7a7-4ea7-9f72-bac13a7c84b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.486160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023eec2-b7a7-4ea7-9f72-bac13a7c84b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.486160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023eec2-b7a7-4ea7-9f72-bac13a7c84b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.492402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023eec2-b7a7-4ea7-9f72-bac13a7c84b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.493888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023eec2-b7a7-4ea7-9f72-bac13a7c84b1 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.504400 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1268/2504] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:22.562335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1237/2505] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:22 2022] PUT /identity/v3/projects/89eb05a8f42347f3b05e5bbfa9f101c0/users/3cbe8eb76c51418d97f096dd73047cb8/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:22.574365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff3a59-b737-416f-8796-b48507d92c8c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.574639 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff3a59-b737-416f-8796-b48507d92c8c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.574909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff3a59-b737-416f-8796-b48507d92c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.603772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2cff3a59-b737-416f-8796-b48507d92c8c None None] MFA Rules not processed for user `3cbe8eb76c51418d97f096dd73047cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:22.604976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2cff3a59-b737-416f-8796-b48507d92c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.682764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1269/2506] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:22.694455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9465b1-ca33-4ecc-bc98-0a31dc30892a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.696230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4d9465b1-ca33-4ecc-bc98-0a31dc30892a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.773325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9465b1-ca33-4ecc-bc98-0a31dc30892a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.773325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb254e6-8477-45c1-927c-433915bc9f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.773325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb254e6-8477-45c1-927c-433915bc9f53 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.773325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb254e6-8477-45c1-927c-433915bc9f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.773715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb254e6-8477-45c1-927c-433915bc9f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.783723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb254e6-8477-45c1-927c-433915bc9f53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.785253 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb254e6-8477-45c1-927c-433915bc9f53 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.797082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1238/2507] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:23.053024 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff3a59-b737-416f-8796-b48507d92c8c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.056967 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2cff3a59-b737-416f-8796-b48507d92c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:23.058517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb254e6-8477-45c1-927c-433915bc9f53 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.060120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3cb254e6-8477-45c1-927c-433915bc9f53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:23.140419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff3a59-b737-416f-8796-b48507d92c8c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.145208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.146032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.146386 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.146726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] PATH_INFO: `/v3/projects/c13b3f6616f84c4d969a65e806afe66c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.147931 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13b3f6616f84c4d969a65e806afe66c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.150036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.151870 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb254e6-8477-45c1-927c-433915bc9f53 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.156539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.157161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.157433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.157773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] PATH_INFO: `/v3/projects/e1fa6571bec34bd3a85f52858da94ea7` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.158889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1fa6571bec34bd3a85f52858da94ea7)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.160918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.162109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:23.178819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:23.259111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13b3f6616f84c4d969a65e806afe66c', 'request_id': 'req-3fc6db13-856e-4723-8c58-dfb00ff401ef'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.264503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13b3f6616f84c4d969a65e806afe66c', 'request_id': 'req-3fc6db13-856e-4723-8c58-dfb00ff401ef'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.270786 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13b3f6616f84c4d969a65e806afe66c', 'request_id': 'req-3fc6db13-856e-4723-8c58-dfb00ff401ef'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.308075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1fa6571bec34bd3a85f52858da94ea7', 'request_id': 'req-1bedf011-9eb7-423f-a039-f3dfc62a1183'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.313530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1fa6571bec34bd3a85f52858da94ea7', 'request_id': 'req-1bedf011-9eb7-423f-a039-f3dfc62a1183'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.320168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1fa6571bec34bd3a85f52858da94ea7', 'request_id': 'req-1bedf011-9eb7-423f-a039-f3dfc62a1183'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.370555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] The token cache is being invalidate because project c13b3f6616f84c4d969a65e806afe66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:23.370847 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.371460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.372939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1270/2508] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:23 2022] DELETE /identity/v3/projects/c13b3f6616f84c4d969a65e806afe66c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:23.376848 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.378306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:23.429250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] The token cache is being invalidate because project e1fa6571bec34bd3a85f52858da94ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:23.429584 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.433674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.433674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1239/2509] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:23 2022] DELETE /identity/v3/projects/e1fa6571bec34bd3a85f52858da94ea7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:23.435752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.437171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:23.479521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6db13-856e-4723-8c58-dfb00ff401ef admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.508928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf011-9eb7-423f-a039-f3dfc62a1183 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.527654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.527654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.527654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.527654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] PATH_INFO: `/v3/users/325ccbea70f44e45b051a680e1043a3d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.528090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325ccbea70f44e45b051a680e1043a3d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.528090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.539290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.539931 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.540213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.540483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] PATH_INFO: `/v3/users/0f57c55d92a84424811611d63b59bc0a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.541668 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f57c55d92a84424811611d63b59bc0a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.543618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.763502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f57c55d92a84424811611d63b59bc0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.764155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f57c55d92a84424811611d63b59bc0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.764753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f57c55d92a84424811611d63b59bc0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.766048 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325ccbea70f44e45b051a680e1043a3d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.767781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:23.773388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325ccbea70f44e45b051a680e1043a3d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.774079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325ccbea70f44e45b051a680e1043a3d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.774687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325ccbea70f44e45b051a680e1043a3d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.863259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f57c55d92a84424811611d63b59bc0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.876090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f57c55d92a84424811611d63b59bc0a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:23.888974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1271/2510] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:23 2022] DELETE /identity/v3/users/0f57c55d92a84424811611d63b59bc0a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:23.981700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325ccbea70f44e45b051a680e1043a3d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.000521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1240/2511] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:23 2022] DELETE /identity/v3/users/325ccbea70f44e45b051a680e1043a3d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:24.384588 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:24.385835 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:24.450310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f7233-956c-47c2-b295-aa7566f08b3a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:24.476657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:24.478399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:24.516530 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:24.524620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:24.527938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:24.527938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:24.527938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] PATH_INFO: `/v3/projects/41a97eef6de5485f85768a8741ddb60f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:24.527938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a97eef6de5485f85768a8741ddb60f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:24.528953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:24.568070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766925c6-d7de-4c9c-b205-8bd0bdec5b65 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:24.568070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:24.568070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:24.568070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:24.568999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] PATH_INFO: `/v3/projects/0f70c5dd440a4664adaea28b42b7f4f1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:24.568999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f70c5dd440a4664adaea28b42b7f4f1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:24.568999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:24.668589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a97eef6de5485f85768a8741ddb60f', 'request_id': 'req-a03faa11-aeca-486c-b003-6cd813661ba1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.674170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a97eef6de5485f85768a8741ddb60f', 'request_id': 'req-a03faa11-aeca-486c-b003-6cd813661ba1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.683580 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a97eef6de5485f85768a8741ddb60f', 'request_id': 'req-a03faa11-aeca-486c-b003-6cd813661ba1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.702416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f70c5dd440a4664adaea28b42b7f4f1', 'request_id': 'req-f0773263-626d-4ca7-b54b-c5fcaa060abd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.708082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f70c5dd440a4664adaea28b42b7f4f1', 'request_id': 'req-f0773263-626d-4ca7-b54b-c5fcaa060abd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.716548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f70c5dd440a4664adaea28b42b7f4f1', 'request_id': 'req-f0773263-626d-4ca7-b54b-c5fcaa060abd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.773299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] The token cache is being invalidate because project 41a97eef6de5485f85768a8741ddb60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:24.773640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.774297 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a03faa11-aeca-486c-b003-6cd813661ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.776019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1272/2512] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:24 2022] DELETE /identity/v3/projects/41a97eef6de5485f85768a8741ddb60f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:24.780574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588e21-4744-475e-847a-be55548eb03c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:24.780855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588e21-4744-475e-847a-be55548eb03c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:24.781124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588e21-4744-475e-847a-be55548eb03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:24.795255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:24.806972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1d588e21-4744-475e-847a-be55548eb03c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:24.808315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1d588e21-4744-475e-847a-be55548eb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:24.858389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] The token cache is being invalidate because project 0f70c5dd440a4664adaea28b42b7f4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:24.858869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.859412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:24.860963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1241/2513] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:24 2022] DELETE /identity/v3/projects/0f70c5dd440a4664adaea28b42b7f4f1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:24.865443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:24.871477 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:24.876339 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1273/2514] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:24.879632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d3d4-ef71-4fff-b0af-c3b14b1fd283 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:24.879937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d3d4-ef71-4fff-b0af-c3b14b1fd283 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:24.880203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d3d4-ef71-4fff-b0af-c3b14b1fd283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:24.881714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0773263-626d-4ca7-b54b-c5fcaa060abd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:24.886493 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:24.887109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:24.887384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:24.887651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] PATH_INFO: `/v3/users/67e47eb2947e4656bcc063d062885197` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:24.888869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e47eb2947e4656bcc063d062885197)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:24.890724 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:24.900302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4de2d3d4-ef71-4fff-b0af-c3b14b1fd283 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:24.901532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4de2d3d4-ef71-4fff-b0af-c3b14b1fd283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:24.910021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1274/2515] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:24.914562 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d3d4-ef71-4fff-b0af-c3b14b1fd283 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:24.928132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d3d4-ef71-4fff-b0af-c3b14b1fd283 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:24.929573 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef460e6-43f4-4804-9ce8-51cf7bb5246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:24.930162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef460e6-43f4-4804-9ce8-51cf7bb5246d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:24.930438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef460e6-43f4-4804-9ce8-51cf7bb5246d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:24.930708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef460e6-43f4-4804-9ce8-51cf7bb5246d admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:24.931352 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef460e6-43f4-4804-9ce8-51cf7bb5246d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:24.931650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef460e6-43f4-4804-9ce8-51cf7bb5246d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:24.933232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef460e6-43f4-4804-9ce8-51cf7bb5246d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:24.944777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1275/2516] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:10:24.949182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef460e6-43f4-4804-9ce8-51cf7bb5246d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:24.959332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef460e6-43f4-4804-9ce8-51cf7bb5246d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:24.964599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7f417-4f5f-4043-99df-a0f3e82ec53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:24.965212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7f417-4f5f-4043-99df-a0f3e82ec53e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:24.965522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7f417-4f5f-4043-99df-a0f3e82ec53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:24.965797 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7f417-4f5f-4043-99df-a0f3e82ec53e admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:24.966403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7f417-4f5f-4043-99df-a0f3e82ec53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:24.968337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7f417-4f5f-4043-99df-a0f3e82ec53e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:25.063841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1276/2517] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:24 2022] POST /identity/v3/projects => generated 357 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:25.068109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7f417-4f5f-4043-99df-a0f3e82ec53e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:25.069880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e47eb2947e4656bcc063d062885197'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.076838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e47eb2947e4656bcc063d062885197'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.077564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e47eb2947e4656bcc063d062885197'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.078185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e47eb2947e4656bcc063d062885197'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.131288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7f417-4f5f-4043-99df-a0f3e82ec53e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:25.136445 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da0a70-deb7-4582-b3e3-c226a520383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:25.137053 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da0a70-deb7-4582-b3e3-c226a520383b admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.137340 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da0a70-deb7-4582-b3e3-c226a520383b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.137837 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da0a70-deb7-4582-b3e3-c226a520383b admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.138269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da0a70-deb7-4582-b3e3-c226a520383b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:25.140225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da0a70-deb7-4582-b3e3-c226a520383b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:25.147489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e47eb2947e4656bcc063d062885197'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.167943 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1242/2518] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:24 2022] DELETE /identity/v3/users/67e47eb2947e4656bcc063d062885197 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:25.236367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1277/2519] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:25 2022] POST /identity/v3/users => generated 279 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:25.240510 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:25.242218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:25.279094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:25.314259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b72f31-25eb-4048-acb5-50cfbb7ba4d2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:25.319442 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b7666-a6b1-4945-9535-92de3bdad7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:25.320066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b7666-a6b1-4945-9535-92de3bdad7cb admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.320437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b7666-a6b1-4945-9535-92de3bdad7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.321507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b7666-a6b1-4945-9535-92de3bdad7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.321507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b7666-a6b1-4945-9535-92de3bdad7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:25.322902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b7666-a6b1-4945-9535-92de3bdad7cb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:25.337333 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1243/2520] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:25.338372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da0a70-deb7-4582-b3e3-c226a520383b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:25.349560 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da0a70-deb7-4582-b3e3-c226a520383b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:25.354206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047ba31-475d-4158-af91-0cd476e6a376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:25.354850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ba31-475d-4158-af91-0cd476e6a376 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.355119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ba31-475d-4158-af91-0cd476e6a376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.355397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ba31-475d-4158-af91-0cd476e6a376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.356037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047ba31-475d-4158-af91-0cd476e6a376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:25.357679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047ba31-475d-4158-af91-0cd476e6a376 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:25.374189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1278/2521] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:25.378771 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b7666-a6b1-4945-9535-92de3bdad7cb admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:25.389645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b7666-a6b1-4945-9535-92de3bdad7cb admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:25.395731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff67f2-a70b-407c-9e14-91443e792526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:25.396393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff67f2-a70b-407c-9e14-91443e792526 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.396665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff67f2-a70b-407c-9e14-91443e792526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.396933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff67f2-a70b-407c-9e14-91443e792526 admin admin] PATH_INFO: `/v3/projects/3c1d8979c5cb4a4c80f380e1365c7fbe/users/f98534ac3d7e461f9002390816cc2bf4/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.418556 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff67f2-a70b-407c-9e14-91443e792526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1d8979c5cb4a4c80f380e1365c7fbe, user_id=f98534ac3d7e461f9002390816cc2bf4, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:25.421719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff67f2-a70b-407c-9e14-91443e792526 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:25.536803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1244/2522] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:25 2022] PUT /identity/v3/projects/3c1d8979c5cb4a4c80f380e1365c7fbe/users/f98534ac3d7e461f9002390816cc2bf4/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:25.547188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9a610-2791-4b92-a66a-061222a3f449 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.547656 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9a610-2791-4b92-a66a-061222a3f449 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.553037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9a610-2791-4b92-a66a-061222a3f449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.581130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-bdd9a610-2791-4b92-a66a-061222a3f449 None None] MFA Rules not processed for user `f98534ac3d7e461f9002390816cc2bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:25.581130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bdd9a610-2791-4b92-a66a-061222a3f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:25.582028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff67f2-a70b-407c-9e14-91443e792526 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:25.582028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-79ff67f2-a70b-407c-9e14-91443e792526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:25.614604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:25.649713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff67f2-a70b-407c-9e14-91443e792526 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:25.650424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1279/2523] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:25.654780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9a610-2791-4b92-a66a-061222a3f449 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:25.658003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:25.658714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.659070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.659489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] PATH_INFO: `/v3/projects/f6b43ee47bfb4242b45df7acab69dad5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.660810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b43ee47bfb4242b45df7acab69dad5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:25.662778 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:25.668132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9a610-2791-4b92-a66a-061222a3f449 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:25.670419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aefaa4-a018-4c56-9416-fbd49d88aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:25.671017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aefaa4-a018-4c56-9416-fbd49d88aea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.671296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aefaa4-a018-4c56-9416-fbd49d88aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.671572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aefaa4-a018-4c56-9416-fbd49d88aea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.672294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aefaa4-a018-4c56-9416-fbd49d88aea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:25.674556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aefaa4-a018-4c56-9416-fbd49d88aea5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:25.796373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b43ee47bfb4242b45df7acab69dad5', 'request_id': 'req-b4103c79-0b3b-41f2-935a-665c40f8c372'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.802465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b43ee47bfb4242b45df7acab69dad5', 'request_id': 'req-b4103c79-0b3b-41f2-935a-665c40f8c372'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.809211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b43ee47bfb4242b45df7acab69dad5', 'request_id': 'req-b4103c79-0b3b-41f2-935a-665c40f8c372'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.815409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1280/2524] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:25 2022] POST /identity/v3/projects => generated 355 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:25.817027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aefaa4-a018-4c56-9416-fbd49d88aea5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:25.881152 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aefaa4-a018-4c56-9416-fbd49d88aea5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:25.885936 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7210-511e-422c-9cd5-704ddd1a0d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:25.886529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7210-511e-422c-9cd5-704ddd1a0d95 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.886803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7210-511e-422c-9cd5-704ddd1a0d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.887067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e7210-511e-422c-9cd5-704ddd1a0d95 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.887678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e7210-511e-422c-9cd5-704ddd1a0d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:25.889630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e7210-511e-422c-9cd5-704ddd1a0d95 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:25.930504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] The token cache is being invalidate because project f6b43ee47bfb4242b45df7acab69dad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:25.931052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.931413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b4103c79-0b3b-41f2-935a-665c40f8c372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:25.932977 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1245/2525] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:25 2022] DELETE /identity/v3/projects/f6b43ee47bfb4242b45df7acab69dad5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:25.938624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732e93-c434-449d-8326-7c4a51499c1f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.938903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732e93-c434-449d-8326-7c4a51499c1f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.939170 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732e93-c434-449d-8326-7c4a51499c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.960589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-54732e93-c434-449d-8326-7c4a51499c1f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:25.961838 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-54732e93-c434-449d-8326-7c4a51499c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:25.969828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1246/2526] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:25.979466 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7001dd-9e92-4ab3-a248-625ca90373ba None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:25.979747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7001dd-9e92-4ab3-a248-625ca90373ba None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:25.980023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7001dd-9e92-4ab3-a248-625ca90373ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:25.983208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1281/2527] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:25 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:25.987019 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7210-511e-422c-9cd5-704ddd1a0d95 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:25.989160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f29e7210-511e-422c-9cd5-704ddd1a0d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:26.002629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e7210-511e-422c-9cd5-704ddd1a0d95 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.006491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fe7001dd-9e92-4ab3-a248-625ca90373ba None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:26.006491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fe7001dd-9e92-4ab3-a248-625ca90373ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:26.008419 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52d8c-653f-401a-9e76-f3d0a8d50ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.009022 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52d8c-653f-401a-9e76-f3d0a8d50ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.009285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52d8c-653f-401a-9e76-f3d0a8d50ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.009594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52d8c-653f-401a-9e76-f3d0a8d50ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.010235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52d8c-653f-401a-9e76-f3d0a8d50ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.011807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52d8c-653f-401a-9e76-f3d0a8d50ff9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.012871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1247/2528] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:26.017091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7001dd-9e92-4ab3-a248-625ca90373ba None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.025261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1282/2529] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:26.026212 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52d8c-653f-401a-9e76-f3d0a8d50ff9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.026715 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7001dd-9e92-4ab3-a248-625ca90373ba None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.031208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491457e0-819a-44bc-8ffc-46fb6ff3b307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.031800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491457e0-819a-44bc-8ffc-46fb6ff3b307 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.032081 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491457e0-819a-44bc-8ffc-46fb6ff3b307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.032351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491457e0-819a-44bc-8ffc-46fb6ff3b307 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.033030 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491457e0-819a-44bc-8ffc-46fb6ff3b307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:26.033336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491457e0-819a-44bc-8ffc-46fb6ff3b307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.035125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491457e0-819a-44bc-8ffc-46fb6ff3b307 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.040855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52d8c-653f-401a-9e76-f3d0a8d50ff9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.040855 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cc184-4d2f-4a46-b0d8-ddf799101db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.041281 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cc184-4d2f-4a46-b0d8-ddf799101db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.041586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cc184-4d2f-4a46-b0d8-ddf799101db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.041854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cc184-4d2f-4a46-b0d8-ddf799101db4 admin admin] PATH_INFO: `/v3/projects/71109fc4a94e47bdbbac753269a5ea92/users/490faa176bcb4c8f8c07f7ae66f08a48/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.050914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1248/2530] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:10:26.051746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491457e0-819a-44bc-8ffc-46fb6ff3b307 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.056632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:26.057761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cc184-4d2f-4a46-b0d8-ddf799101db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71109fc4a94e47bdbbac753269a5ea92, user_id=490faa176bcb4c8f8c07f7ae66f08a48, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.060427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cc184-4d2f-4a46-b0d8-ddf799101db4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.061779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491457e0-819a-44bc-8ffc-46fb6ff3b307 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.067596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0163-0af6-4e21-b9fa-bc6ca9edfaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.068190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0163-0af6-4e21-b9fa-bc6ca9edfaa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.068983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0163-0af6-4e21-b9fa-bc6ca9edfaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.068983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0163-0af6-4e21-b9fa-bc6ca9edfaa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.069327 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f0163-0af6-4e21-b9fa-bc6ca9edfaa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.071309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f0163-0af6-4e21-b9fa-bc6ca9edfaa2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.141058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1283/2531] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:26 2022] PUT /identity/v3/projects/71109fc4a94e47bdbbac753269a5ea92/users/490faa176bcb4c8f8c07f7ae66f08a48/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:26.145032 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cc184-4d2f-4a46-b0d8-ddf799101db4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.164770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1249/2532] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:26 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:26.169243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0163-0af6-4e21-b9fa-bc6ca9edfaa2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.209789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cc184-4d2f-4a46-b0d8-ddf799101db4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.218509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:26.236314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0163-0af6-4e21-b9fa-bc6ca9edfaa2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.242439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab2603-91f2-4f34-b10d-a2df2e1143a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.243184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab2603-91f2-4f34-b10d-a2df2e1143a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.243469 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab2603-91f2-4f34-b10d-a2df2e1143a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.243743 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab2603-91f2-4f34-b10d-a2df2e1143a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.244366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab2603-91f2-4f34-b10d-a2df2e1143a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.246312 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab2603-91f2-4f34-b10d-a2df2e1143a1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.276586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1f234-f4f7-4cd8-b190-47f494706e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.277271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1f234-f4f7-4cd8-b190-47f494706e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.277658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1f234-f4f7-4cd8-b190-47f494706e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.277933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1f234-f4f7-4cd8-b190-47f494706e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.278570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1f234-f4f7-4cd8-b190-47f494706e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.280143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1f234-f4f7-4cd8-b190-47f494706e65 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.293496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1284/2533] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:26.295156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1f234-f4f7-4cd8-b190-47f494706e65 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.306798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1f234-f4f7-4cd8-b190-47f494706e65 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.311854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e762d-e332-4e4f-b648-32d00a57d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.312516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e762d-e332-4e4f-b648-32d00a57d609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.312793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e762d-e332-4e4f-b648-32d00a57d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.313067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e762d-e332-4e4f-b648-32d00a57d609 admin admin] PATH_INFO: `/v3/projects/71109fc4a94e47bdbbac753269a5ea92/users/490faa176bcb4c8f8c07f7ae66f08a48/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.315040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e762d-e332-4e4f-b648-32d00a57d609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71109fc4a94e47bdbbac753269a5ea92, user_id=490faa176bcb4c8f8c07f7ae66f08a48, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.318999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e762d-e332-4e4f-b648-32d00a57d609 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.330089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1285/2534] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:26 2022] PUT /identity/v3/projects/71109fc4a94e47bdbbac753269a5ea92/users/490faa176bcb4c8f8c07f7ae66f08a48/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:26.343487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89f35-0292-43c8-9332-a46a4ea014fc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.343808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89f35-0292-43c8-9332-a46a4ea014fc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.345840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf89f35-0292-43c8-9332-a46a4ea014fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.374132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1250/2535] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:26 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:26.376020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-baf89f35-0292-43c8-9332-a46a4ea014fc None None] MFA Rules not processed for user `490faa176bcb4c8f8c07f7ae66f08a48`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:26.377106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab2603-91f2-4f34-b10d-a2df2e1143a1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.378567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-baf89f35-0292-43c8-9332-a46a4ea014fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:26.392519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab2603-91f2-4f34-b10d-a2df2e1143a1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.473304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1286/2536] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:26.478502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f7524-4d9c-4e78-97aa-72b7e53e1e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.482802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f7524-4d9c-4e78-97aa-72b7e53e1e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.482802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f7524-4d9c-4e78-97aa-72b7e53e1e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.482802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f7524-4d9c-4e78-97aa-72b7e53e1e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.482802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f7524-4d9c-4e78-97aa-72b7e53e1e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.482802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f7524-4d9c-4e78-97aa-72b7e53e1e7f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.484918 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf89f35-0292-43c8-9332-a46a4ea014fc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.486505 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-baf89f35-0292-43c8-9332-a46a4ea014fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:26.512282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1251/2537] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:26.517153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f7524-4d9c-4e78-97aa-72b7e53e1e7f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.524482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f7524-4d9c-4e78-97aa-72b7e53e1e7f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.529769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01930b5-498b-4c42-9c96-f0d3afa6a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.530463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01930b5-498b-4c42-9c96-f0d3afa6a13b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.530826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01930b5-498b-4c42-9c96-f0d3afa6a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.531266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01930b5-498b-4c42-9c96-f0d3afa6a13b admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.532072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01930b5-498b-4c42-9c96-f0d3afa6a13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.533804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01930b5-498b-4c42-9c96-f0d3afa6a13b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.545150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1252/2538] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:26.549259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01930b5-498b-4c42-9c96-f0d3afa6a13b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.557830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf89f35-0292-43c8-9332-a46a4ea014fc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.559490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01930b5-498b-4c42-9c96-f0d3afa6a13b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.561422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11968855-1920-421d-ad0d-0bba09b8582d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.562055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11968855-1920-421d-ad0d-0bba09b8582d service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.562332 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11968855-1920-421d-ad0d-0bba09b8582d service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.562635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11968855-1920-421d-ad0d-0bba09b8582d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.564429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d714e8-1524-4628-89ba-3eec3ddcdb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.564867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d714e8-1524-4628-89ba-3eec3ddcdb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.565147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d714e8-1524-4628-89ba-3eec3ddcdb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.565954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d714e8-1524-4628-89ba-3eec3ddcdb12 admin admin] PATH_INFO: `/v3/projects/7c88d99bb94a4a8480dff6ba78a1792b/users/b8ec45ea93e9459bb4e33068b95ef4e9/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.575892 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11968855-1920-421d-ad0d-0bba09b8582d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.577736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11968855-1920-421d-ad0d-0bba09b8582d service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.580965 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d714e8-1524-4628-89ba-3eec3ddcdb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c88d99bb94a4a8480dff6ba78a1792b, user_id=b8ec45ea93e9459bb4e33068b95ef4e9, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.584304 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d714e8-1524-4628-89ba-3eec3ddcdb12 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.589082 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1287/2539] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:26.641237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1253/2540] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:26 2022] PUT /identity/v3/projects/7c88d99bb94a4a8480dff6ba78a1792b/users/b8ec45ea93e9459bb4e33068b95ef4e9/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:26.652593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77780ec9-846b-4b8a-b1ae-8c25fffc9157 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.652895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77780ec9-846b-4b8a-b1ae-8c25fffc9157 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.653167 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77780ec9-846b-4b8a-b1ae-8c25fffc9157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.704597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-77780ec9-846b-4b8a-b1ae-8c25fffc9157 None None] MFA Rules not processed for user `b8ec45ea93e9459bb4e33068b95ef4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:26.706695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-77780ec9-846b-4b8a-b1ae-8c25fffc9157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:26.719081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:26.776294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1288/2541] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:26.780915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d714e8-1524-4628-89ba-3eec3ddcdb12 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.815444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77780ec9-846b-4b8a-b1ae-8c25fffc9157 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:26.818805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:26.850763 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d714e8-1524-4628-89ba-3eec3ddcdb12 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.855576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f19e02-116a-4b50-af5a-a63175b9829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.876150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f19e02-116a-4b50-af5a-a63175b9829d admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.876150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f19e02-116a-4b50-af5a-a63175b9829d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.876150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f19e02-116a-4b50-af5a-a63175b9829d admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.876150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f19e02-116a-4b50-af5a-a63175b9829d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.876150 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f19e02-116a-4b50-af5a-a63175b9829d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.876627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77780ec9-846b-4b8a-b1ae-8c25fffc9157 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:26.878868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea5c4a-ef69-4f90-a615-4490115a6474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:26.879746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea5c4a-ef69-4f90-a615-4490115a6474 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:26.880027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea5c4a-ef69-4f90-a615-4490115a6474 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:26.880298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea5c4a-ef69-4f90-a615-4490115a6474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:26.882090 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6dea5c4a-ef69-4f90-a615-4490115a6474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:26.945880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea5c4a-ef69-4f90-a615-4490115a6474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:26.947412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea5c4a-ef69-4f90-a615-4490115a6474 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:26.956869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1289/2542] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:27.008306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1254/2543] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:26 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:27.008785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea5c4a-ef69-4f90-a615-4490115a6474 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:27.018700 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea5c4a-ef69-4f90-a615-4490115a6474 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:27.077659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be6e6f-37d5-4b88-ae7f-63f7f45e8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:27.078190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be6e6f-37d5-4b88-ae7f-63f7f45e8062 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.078466 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be6e6f-37d5-4b88-ae7f-63f7f45e8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.078733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be6e6f-37d5-4b88-ae7f-63f7f45e8062 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.079375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be6e6f-37d5-4b88-ae7f-63f7f45e8062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:27.081291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be6e6f-37d5-4b88-ae7f-63f7f45e8062 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:27.156470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:27.214442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1290/2544] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:27 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:27.220551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f19e02-116a-4b50-af5a-a63175b9829d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:27.229663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f19e02-116a-4b50-af5a-a63175b9829d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:27.234470 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c21c05-0b48-4969-a361-ea60f7e14871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:27.235068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c21c05-0b48-4969-a361-ea60f7e14871 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.235344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c21c05-0b48-4969-a361-ea60f7e14871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.235615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c21c05-0b48-4969-a361-ea60f7e14871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.236252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c21c05-0b48-4969-a361-ea60f7e14871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:27.238601 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c21c05-0b48-4969-a361-ea60f7e14871 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:27.249070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1255/2545] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:27.253278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be6e6f-37d5-4b88-ae7f-63f7f45e8062 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:27.263491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be6e6f-37d5-4b88-ae7f-63f7f45e8062 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:27.268092 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7a5e-9088-4679-8ca9-1d03893c2f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:27.268770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7a5e-9088-4679-8ca9-1d03893c2f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.269047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7a5e-9088-4679-8ca9-1d03893c2f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.269313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7a5e-9088-4679-8ca9-1d03893c2f95 admin admin] PATH_INFO: `/v3/projects/acafc72bc0ba4403bb127bfc755a1330/users/27980f51298c4051863f25385f9d6a35/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.283803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d7a5e-9088-4679-8ca9-1d03893c2f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acafc72bc0ba4403bb127bfc755a1330, user_id=27980f51298c4051863f25385f9d6a35, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:27.287149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d7a5e-9088-4679-8ca9-1d03893c2f95 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:27.348623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1291/2546] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:27 2022] PUT /identity/v3/projects/acafc72bc0ba4403bb127bfc755a1330/users/27980f51298c4051863f25385f9d6a35/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:27.352928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c21c05-0b48-4969-a361-ea60f7e14871 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:27.363403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c21c05-0b48-4969-a361-ea60f7e14871 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:27.422597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cbb20-0218-4a72-95aa-860e568d86cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:27.423412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cbb20-0218-4a72-95aa-860e568d86cf admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.423785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cbb20-0218-4a72-95aa-860e568d86cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.424149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cbb20-0218-4a72-95aa-860e568d86cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.424803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cbb20-0218-4a72-95aa-860e568d86cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:27.426576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cbb20-0218-4a72-95aa-860e568d86cf admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:27.441092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1256/2547] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:27.442310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7a5e-9088-4679-8ca9-1d03893c2f95 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:27.455191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7a5e-9088-4679-8ca9-1d03893c2f95 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:27.461399 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d3833-7f60-4def-b169-8fa2cae69620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:27.463446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d3833-7f60-4def-b169-8fa2cae69620 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.463446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d3833-7f60-4def-b169-8fa2cae69620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.463446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d3833-7f60-4def-b169-8fa2cae69620 admin admin] PATH_INFO: `/v3/projects/acafc72bc0ba4403bb127bfc755a1330/users/27980f51298c4051863f25385f9d6a35/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.464544 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d3833-7f60-4def-b169-8fa2cae69620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acafc72bc0ba4403bb127bfc755a1330, user_id=27980f51298c4051863f25385f9d6a35, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:27.467462 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d3833-7f60-4def-b169-8fa2cae69620 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:27.478353 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1292/2548] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:27 2022] PUT /identity/v3/projects/acafc72bc0ba4403bb127bfc755a1330/users/27980f51298c4051863f25385f9d6a35/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:27.488990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abdc8-acd4-477c-af81-104756410937 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.489268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abdc8-acd4-477c-af81-104756410937 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.489564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2abdc8-acd4-477c-af81-104756410937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.516958 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cd2abdc8-acd4-477c-af81-104756410937 None None] MFA Rules not processed for user `27980f51298c4051863f25385f9d6a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:27.518185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cd2abdc8-acd4-477c-af81-104756410937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:27.586859 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1257/2549] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:27.598869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d3833-7f60-4def-b169-8fa2cae69620 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:27.654630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d3833-7f60-4def-b169-8fa2cae69620 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:27.658460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501f4a2-4fc1-4d75-9434-deca48deada8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:27.659060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501f4a2-4fc1-4d75-9434-deca48deada8 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.659374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501f4a2-4fc1-4d75-9434-deca48deada8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.659627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501f4a2-4fc1-4d75-9434-deca48deada8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.669626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501f4a2-4fc1-4d75-9434-deca48deada8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:27.671093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501f4a2-4fc1-4d75-9434-deca48deada8 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:27.680741 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1293/2550] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:27.784336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2abdc8-acd4-477c-af81-104756410937 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:27.795921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2abdc8-acd4-477c-af81-104756410937 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:27.799765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518aeef-5e76-4869-947e-339df33fa5c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:27.801194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518aeef-5e76-4869-947e-339df33fa5c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.801194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518aeef-5e76-4869-947e-339df33fa5c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.801194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518aeef-5e76-4869-947e-339df33fa5c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.827585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:27.861753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518aeef-5e76-4869-947e-339df33fa5c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:27.863344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518aeef-5e76-4869-947e-339df33fa5c4 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:27.872640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1258/2551] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:31.082064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501f4a2-4fc1-4d75-9434-deca48deada8 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:31.146845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501f4a2-4fc1-4d75-9434-deca48deada8 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:31.151412 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:31.152031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:31.152312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:31.152589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] PATH_INFO: `/v3/users/b8ec45ea93e9459bb4e33068b95ef4e9` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:31.153750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ec45ea93e9459bb4e33068b95ef4e9)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:31.155724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:31.353325 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ec45ea93e9459bb4e33068b95ef4e9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:31.353995 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ec45ea93e9459bb4e33068b95ef4e9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:31.354582 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ec45ea93e9459bb4e33068b95ef4e9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:31.421702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ec45ea93e9459bb4e33068b95ef4e9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:31.429716 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:31.435085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ec45ea93e9459bb4e33068b95ef4e9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:31.447657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1294/2552] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:31 2022] DELETE /identity/v3/users/b8ec45ea93e9459bb4e33068b95ef4e9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:31.452186 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c70885-fe1c-4599-b73d-41313ed948ca None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:31.452643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c70885-fe1c-4599-b73d-41313ed948ca None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:31.452740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c70885-fe1c-4599-b73d-41313ed948ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:31.472283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a2c70885-fe1c-4599-b73d-41313ed948ca None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:31.473546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a2c70885-fe1c-4599-b73d-41313ed948ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:31.530757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1259/2553] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:31.541004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:31.542511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:31.603602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c13de-dd2b-47fd-948a-0d300b7497d3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:31.608493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9019f8-257a-4e2c-8afe-14e688159780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:31.608780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9019f8-257a-4e2c-8afe-14e688159780 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:31.609058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9019f8-257a-4e2c-8afe-14e688159780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:31.609329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9019f8-257a-4e2c-8afe-14e688159780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:31.619406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9019f8-257a-4e2c-8afe-14e688159780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:31.620883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9019f8-257a-4e2c-8afe-14e688159780 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:31.632041 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1295/2554] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:32.088986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c70885-fe1c-4599-b73d-41313ed948ca None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:32.092242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a2c70885-fe1c-4599-b73d-41313ed948ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:32.103930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c70885-fe1c-4599-b73d-41313ed948ca None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:32.111713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:32.112427 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:32.112840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:32.113116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] PATH_INFO: `/v3/projects/7c88d99bb94a4a8480dff6ba78a1792b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:32.114348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c88d99bb94a4a8480dff6ba78a1792b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:32.117120 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:32.250991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c88d99bb94a4a8480dff6ba78a1792b', 'request_id': 'req-e4718160-2819-4599-a6f9-3062ed4a6574'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.258539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c88d99bb94a4a8480dff6ba78a1792b', 'request_id': 'req-e4718160-2819-4599-a6f9-3062ed4a6574'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.270425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c88d99bb94a4a8480dff6ba78a1792b', 'request_id': 'req-e4718160-2819-4599-a6f9-3062ed4a6574'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.375970 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] The token cache is being invalidate because project 7c88d99bb94a4a8480dff6ba78a1792b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:32.376252 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.376885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.378689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1260/2555] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:32 2022] DELETE /identity/v3/projects/7c88d99bb94a4a8480dff6ba78a1792b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:32.383056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9019f8-257a-4e2c-8afe-14e688159780 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:32.395328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9019f8-257a-4e2c-8afe-14e688159780 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:32.468863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:32.469521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:32.469800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:32.470063 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] PATH_INFO: `/v3/users/27980f51298c4051863f25385f9d6a35` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:32.471187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27980f51298c4051863f25385f9d6a35)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:32.473177 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:32.675117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27980f51298c4051863f25385f9d6a35'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.676018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27980f51298c4051863f25385f9d6a35'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.676634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27980f51298c4051863f25385f9d6a35'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.850422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27980f51298c4051863f25385f9d6a35'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.865785 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9e015a2e-9398-4e75-8365-5e2e156366b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27980f51298c4051863f25385f9d6a35'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:32.879087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1296/2556] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:32 2022] DELETE /identity/v3/users/27980f51298c4051863f25385f9d6a35 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:32.909790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:32.912526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:32.926070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718160-2819-4599-a6f9-3062ed4a6574 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:32.999817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:33.012285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:33.013134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.013406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.013802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] PATH_INFO: `/v3/users/3cbe8eb76c51418d97f096dd73047cb8` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.014985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbe8eb76c51418d97f096dd73047cb8)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:33.016889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:33.234235 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbe8eb76c51418d97f096dd73047cb8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.258361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbe8eb76c51418d97f096dd73047cb8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.259138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbe8eb76c51418d97f096dd73047cb8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.259855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbe8eb76c51418d97f096dd73047cb8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.359607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbe8eb76c51418d97f096dd73047cb8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.399123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1261/2557] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:32 2022] DELETE /identity/v3/users/3cbe8eb76c51418d97f096dd73047cb8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:33.403629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d31c1-b59c-41fa-aafe-232949ad536d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.404534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d31c1-b59c-41fa-aafe-232949ad536d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.404960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d31c1-b59c-41fa-aafe-232949ad536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.413310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:33.428456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-cc4d31c1-b59c-41fa-aafe-232949ad536d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:33.429793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cc4d31c1-b59c-41fa-aafe-232949ad536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:33.505739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1297/2558] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:33.515989 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:33.517437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:33.567722 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d31c1-b59c-41fa-aafe-232949ad536d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:33.569672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cc4d31c1-b59c-41fa-aafe-232949ad536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:33.586283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d31c1-b59c-41fa-aafe-232949ad536d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:33.592447 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:33.596274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.596274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.596274 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] PATH_INFO: `/v3/projects/acafc72bc0ba4403bb127bfc755a1330` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.596914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=acafc72bc0ba4403bb127bfc755a1330)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:33.599800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:33.600056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129a885-22dc-40d1-86f5-56ef8113b7ac admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:33.604518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b75a6-e13c-410c-87f2-e526d532b0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:33.605361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b75a6-e13c-410c-87f2-e526d532b0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.605994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b75a6-e13c-410c-87f2-e526d532b0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.606345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b75a6-e13c-410c-87f2-e526d532b0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.618546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b75a6-e13c-410c-87f2-e526d532b0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:33.620471 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b75a6-e13c-410c-87f2-e526d532b0f3 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:33.635656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1262/2559] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:33.764323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acafc72bc0ba4403bb127bfc755a1330', 'request_id': 'req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.770182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acafc72bc0ba4403bb127bfc755a1330', 'request_id': 'req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.788631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acafc72bc0ba4403bb127bfc755a1330', 'request_id': 'req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.866885 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] The token cache is being invalidate because project acafc72bc0ba4403bb127bfc755a1330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:33.867172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.868042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ade6b1d7-e6c3-4e2f-a81c-f296ff0950cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:33.869770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1298/2560] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:33 2022] DELETE /identity/v3/projects/acafc72bc0ba4403bb127bfc755a1330 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:33.874821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75896-2fa3-4938-a37a-0d5e93207b4f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.875183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75896-2fa3-4938-a37a-0d5e93207b4f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.875467 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75896-2fa3-4938-a37a-0d5e93207b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.903226 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-bcf75896-2fa3-4938-a37a-0d5e93207b4f None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:33.903226 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bcf75896-2fa3-4938-a37a-0d5e93207b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:33.994481 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1263/2561] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:34.003801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944a0e9-d33f-473d-b7f5-fca3daed7e8e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.004086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944a0e9-d33f-473d-b7f5-fca3daed7e8e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.004360 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944a0e9-d33f-473d-b7f5-fca3daed7e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.030734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d944a0e9-d33f-473d-b7f5-fca3daed7e8e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:34.033083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d944a0e9-d33f-473d-b7f5-fca3daed7e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:34.048407 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1299/2562] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:34.053347 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75896-2fa3-4938-a37a-0d5e93207b4f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.060565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75896-2fa3-4938-a37a-0d5e93207b4f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.067528 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.068797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.069133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.069500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.070437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:34.070612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.072278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.080482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:34.087640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1264/2563] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:34.095425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944a0e9-d33f-473d-b7f5-fca3daed7e8e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.112555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944a0e9-d33f-473d-b7f5-fca3daed7e8e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.131161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfbacc-af2f-4125-8806-0f17aa51c0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.132599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfbacc-af2f-4125-8806-0f17aa51c0ed admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.133031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfbacc-af2f-4125-8806-0f17aa51c0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.133453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfbacc-af2f-4125-8806-0f17aa51c0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.134329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfbacc-af2f-4125-8806-0f17aa51c0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.136289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfbacc-af2f-4125-8806-0f17aa51c0ed admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.186164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.187948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:34.233182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5879a2-6b0d-4019-b11d-cfebb779e3d8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.243212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.247195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.247195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.247195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] PATH_INFO: `/v3/projects/89eb05a8f42347f3b05e5bbfa9f101c0` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.247195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=89eb05a8f42347f3b05e5bbfa9f101c0)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.248685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.278933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1300/2564] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:34 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:34.280091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfbacc-af2f-4125-8806-0f17aa51c0ed admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.358524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:34.365248 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfbacc-af2f-4125-8806-0f17aa51c0ed admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.373452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431699b-5a54-444d-82c9-6b783e4c8563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.378745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431699b-5a54-444d-82c9-6b783e4c8563 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.378745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431699b-5a54-444d-82c9-6b783e4c8563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.378745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431699b-5a54-444d-82c9-6b783e4c8563 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.378745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431699b-5a54-444d-82c9-6b783e4c8563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.379277 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431699b-5a54-444d-82c9-6b783e4c8563 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.396690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89eb05a8f42347f3b05e5bbfa9f101c0', 'request_id': 'req-034404b4-66dc-47bf-8caa-a0d09efea78b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:34.402654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89eb05a8f42347f3b05e5bbfa9f101c0', 'request_id': 'req-034404b4-66dc-47bf-8caa-a0d09efea78b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:34.409533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89eb05a8f42347f3b05e5bbfa9f101c0', 'request_id': 'req-034404b4-66dc-47bf-8caa-a0d09efea78b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:34.463405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1301/2565] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:34 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:34.464474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431699b-5a54-444d-82c9-6b783e4c8563 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.474481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431699b-5a54-444d-82c9-6b783e4c8563 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.487198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] The token cache is being invalidate because project 89eb05a8f42347f3b05e5bbfa9f101c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:34.492659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:34.492659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-034404b4-66dc-47bf-8caa-a0d09efea78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:34.492659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1265/2566] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:34 2022] DELETE /identity/v3/projects/89eb05a8f42347f3b05e5bbfa9f101c0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:34.496070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43e76f-3929-47cd-831b-f98a3773eabd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.496473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43e76f-3929-47cd-831b-f98a3773eabd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.496747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43e76f-3929-47cd-831b-f98a3773eabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.521671 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-8a43e76f-3929-47cd-831b-f98a3773eabd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:34.521671 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8a43e76f-3929-47cd-831b-f98a3773eabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:34.533782 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dd371-f283-402d-a210-1855eafd991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.534469 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dd371-f283-402d-a210-1855eafd991e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.534743 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dd371-f283-402d-a210-1855eafd991e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.535011 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dd371-f283-402d-a210-1855eafd991e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.535645 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dd371-f283-402d-a210-1855eafd991e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.537299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dd371-f283-402d-a210-1855eafd991e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.547387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1302/2567] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:34.551461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dd371-f283-402d-a210-1855eafd991e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.553695 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9b7dd371-f283-402d-a210-1855eafd991e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:34.566438 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dd371-f283-402d-a210-1855eafd991e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.571867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c09d72-8557-45ba-836c-f367c7af848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.572467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c09d72-8557-45ba-836c-f367c7af848b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.572750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c09d72-8557-45ba-836c-f367c7af848b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.573054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c09d72-8557-45ba-836c-f367c7af848b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.573718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c09d72-8557-45ba-836c-f367c7af848b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.575316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c09d72-8557-45ba-836c-f367c7af848b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.581054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1266/2568] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:34.589588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc37267-2d00-494a-95b2-0d3b0da3614b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.589836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc37267-2d00-494a-95b2-0d3b0da3614b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.590221 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc37267-2d00-494a-95b2-0d3b0da3614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.594650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1303/2569] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:34.607954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c09d72-8557-45ba-836c-f367c7af848b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.622377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c09d72-8557-45ba-836c-f367c7af848b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.631168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53474-63f6-415d-bd67-f90b0030238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.631168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53474-63f6-415d-bd67-f90b0030238c admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.631168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53474-63f6-415d-bd67-f90b0030238c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.631168 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53474-63f6-415d-bd67-f90b0030238c admin admin] PATH_INFO: `/v3/projects/81113b71fa3f45629f85dafacb89f519/users/3e84e80d65284ca59b78b229eb399edf/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.649723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53474-63f6-415d-bd67-f90b0030238c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81113b71fa3f45629f85dafacb89f519, user_id=3e84e80d65284ca59b78b229eb399edf, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.653017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53474-63f6-415d-bd67-f90b0030238c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.736686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1304/2570] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:34 2022] PUT /identity/v3/projects/81113b71fa3f45629f85dafacb89f519/users/3e84e80d65284ca59b78b229eb399edf/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:34.747488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eee01f-cf15-4bad-be38-210bb57177a0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.747768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eee01f-cf15-4bad-be38-210bb57177a0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.748037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eee01f-cf15-4bad-be38-210bb57177a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.750557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dcc37267-2d00-494a-95b2-0d3b0da3614b None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:34.751770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dcc37267-2d00-494a-95b2-0d3b0da3614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:34.776985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-29eee01f-cf15-4bad-be38-210bb57177a0 None None] MFA Rules not processed for user `3e84e80d65284ca59b78b229eb399edf`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:34.778138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-29eee01f-cf15-4bad-be38-210bb57177a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:34.813610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1267/2571] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:34.818864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc37267-2d00-494a-95b2-0d3b0da3614b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.827924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc37267-2d00-494a-95b2-0d3b0da3614b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.832684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.833272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.834090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.834360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.835001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:34.835300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.836877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.843432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1305/2572] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:34.848421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1268/2573] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:34.852820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eee01f-cf15-4bad-be38-210bb57177a0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.855185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:34.856880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:34.863613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eee01f-cf15-4bad-be38-210bb57177a0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.869452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93ac93-7076-461c-a620-9716df1b2491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.870262 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93ac93-7076-461c-a620-9716df1b2491 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.870537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93ac93-7076-461c-a620-9716df1b2491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.870803 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93ac93-7076-461c-a620-9716df1b2491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.871496 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93ac93-7076-461c-a620-9716df1b2491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.873446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93ac93-7076-461c-a620-9716df1b2491 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.913298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156c580-3a45-4b40-baa2-caf6e5235f1d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:34.916836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369da5-3e86-4c4b-96cf-dc7b2bf02dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:34.917573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369da5-3e86-4c4b-96cf-dc7b2bf02dad service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:34.917847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369da5-3e86-4c4b-96cf-dc7b2bf02dad service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:34.918118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52369da5-3e86-4c4b-96cf-dc7b2bf02dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:34.926052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52369da5-3e86-4c4b-96cf-dc7b2bf02dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:34.927976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52369da5-3e86-4c4b-96cf-dc7b2bf02dad service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:34.936430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1269/2574] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:34.996456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1306/2575] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:34 2022] POST /identity/v3/projects => generated 401 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:35.003492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369da5-3e86-4c4b-96cf-dc7b2bf02dad service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:35.017507 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52369da5-3e86-4c4b-96cf-dc7b2bf02dad service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:35.054833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:35.084490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1176-bea2-4701-803a-878dcbe45c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:35.085123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1176-bea2-4701-803a-878dcbe45c7c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.085401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1176-bea2-4701-803a-878dcbe45c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.085742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1176-bea2-4701-803a-878dcbe45c7c admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.086349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1176-bea2-4701-803a-878dcbe45c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:35.088238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1176-bea2-4701-803a-878dcbe45c7c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:35.189140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1270/2576] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:34 2022] POST /identity/v3/users => generated 301 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:35.193146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93ac93-7076-461c-a620-9716df1b2491 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:35.205833 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93ac93-7076-461c-a620-9716df1b2491 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:35.209495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5c253-cc1d-48ee-9246-3f793ede2f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:35.210204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5c253-cc1d-48ee-9246-3f793ede2f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.210547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5c253-cc1d-48ee-9246-3f793ede2f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.210888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5c253-cc1d-48ee-9246-3f793ede2f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.211594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5c253-cc1d-48ee-9246-3f793ede2f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:35.213257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5c253-cc1d-48ee-9246-3f793ede2f0e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:35.225259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1307/2577] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:35.228874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1176-bea2-4701-803a-878dcbe45c7c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:35.242000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1176-bea2-4701-803a-878dcbe45c7c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:35.246949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd8d94-a2e3-40e5-97a3-601c83bc378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:35.247619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd8d94-a2e3-40e5-97a3-601c83bc378d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.247974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd8d94-a2e3-40e5-97a3-601c83bc378d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.248297 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd8d94-a2e3-40e5-97a3-601c83bc378d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.248998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd8d94-a2e3-40e5-97a3-601c83bc378d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:35.250716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd8d94-a2e3-40e5-97a3-601c83bc378d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:35.265833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1271/2578] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:35.270702 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5c253-cc1d-48ee-9246-3f793ede2f0e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:35.273667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:35.277834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5c253-cc1d-48ee-9246-3f793ede2f0e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:35.289069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790d786-241e-4160-88c3-332c2ea4b3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:35.293611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790d786-241e-4160-88c3-332c2ea4b3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.293611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790d786-241e-4160-88c3-332c2ea4b3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.293611 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790d786-241e-4160-88c3-332c2ea4b3d5 admin admin] PATH_INFO: `/v3/projects/3c3fb5734e4243d5b5a145b64e3c42b7/users/cde7e6f5c3234482a19e1cdef6affaba/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.308418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790d786-241e-4160-88c3-332c2ea4b3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c3fb5734e4243d5b5a145b64e3c42b7, user_id=cde7e6f5c3234482a19e1cdef6affaba, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:35.311127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790d786-241e-4160-88c3-332c2ea4b3d5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:35.418175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1308/2579] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:35 2022] PUT /identity/v3/projects/3c3fb5734e4243d5b5a145b64e3c42b7/users/cde7e6f5c3234482a19e1cdef6affaba/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:35.431071 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a51de-84d7-44c1-a28e-88abe0a22b6e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.431660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a51de-84d7-44c1-a28e-88abe0a22b6e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.431955 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a51de-84d7-44c1-a28e-88abe0a22b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.462106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-216a51de-84d7-44c1-a28e-88abe0a22b6e None None] MFA Rules not processed for user `cde7e6f5c3234482a19e1cdef6affaba`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:35.463324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-216a51de-84d7-44c1-a28e-88abe0a22b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:35.532296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1272/2580] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:35 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:35.536818 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790d786-241e-4160-88c3-332c2ea4b3d5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:35.600223 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790d786-241e-4160-88c3-332c2ea4b3d5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:35.604900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc20b7-0849-4c2c-a6f9-644887758095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:35.605714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc20b7-0849-4c2c-a6f9-644887758095 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.606432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc20b7-0849-4c2c-a6f9-644887758095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.606712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc20b7-0849-4c2c-a6f9-644887758095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.607356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc20b7-0849-4c2c-a6f9-644887758095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:35.609270 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc20b7-0849-4c2c-a6f9-644887758095 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:35.753054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1309/2581] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:35 2022] POST /identity/v3/projects => generated 401 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:35.757823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a51de-84d7-44c1-a28e-88abe0a22b6e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:35.778774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a51de-84d7-44c1-a28e-88abe0a22b6e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:35.804104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:35.850895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa6191-6cb8-4adb-b7a5-edcb5aa0d1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:35.851509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa6191-6cb8-4adb-b7a5-edcb5aa0d1cb admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.851782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa6191-6cb8-4adb-b7a5-edcb5aa0d1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.852047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa6191-6cb8-4adb-b7a5-edcb5aa0d1cb admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.852672 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa6191-6cb8-4adb-b7a5-edcb5aa0d1cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:35.854604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa6191-6cb8-4adb-b7a5-edcb5aa0d1cb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:35.976790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1273/2582] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:35 2022] POST /identity/v3/users => generated 307 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:35.978103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc20b7-0849-4c2c-a6f9-644887758095 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:35.988880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc20b7-0849-4c2c-a6f9-644887758095 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:35.994494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e50bf9-5adc-4efd-8667-b898176d2c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:35.995098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e50bf9-5adc-4efd-8667-b898176d2c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.995371 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e50bf9-5adc-4efd-8667-b898176d2c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.995693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e50bf9-5adc-4efd-8667-b898176d2c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.996333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e50bf9-5adc-4efd-8667-b898176d2c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:35.997944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e50bf9-5adc-4efd-8667-b898176d2c1a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:36.015301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1310/2583] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:36.016827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa6191-6cb8-4adb-b7a5-edcb5aa0d1cb admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:36.027516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa6191-6cb8-4adb-b7a5-edcb5aa0d1cb admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:36.032149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c07e-64c3-4522-a294-79111f332805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:36.032831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c07e-64c3-4522-a294-79111f332805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:36.033108 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c07e-64c3-4522-a294-79111f332805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:36.033380 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c07e-64c3-4522-a294-79111f332805 admin admin] PATH_INFO: `/v3/projects/2466188004a64705ba2e3eac2e9f4940/users/defa1e25cdbb469baddb509c77425385/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:36.049086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c07e-64c3-4522-a294-79111f332805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2466188004a64705ba2e3eac2e9f4940, user_id=defa1e25cdbb469baddb509c77425385, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:36.051776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854c07e-64c3-4522-a294-79111f332805 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:36.236214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1274/2584] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:36 2022] PUT /identity/v3/projects/2466188004a64705ba2e3eac2e9f4940/users/defa1e25cdbb469baddb509c77425385/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:36.240980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e50bf9-5adc-4efd-8667-b898176d2c1a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:36.251470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e50bf9-5adc-4efd-8667-b898176d2c1a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:36.314440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc77d5a-70dd-4530-b9bd-0ac74e7ee3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:36.315134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc77d5a-70dd-4530-b9bd-0ac74e7ee3ac admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:36.315462 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc77d5a-70dd-4530-b9bd-0ac74e7ee3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:36.315790 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc77d5a-70dd-4530-b9bd-0ac74e7ee3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:36.316494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc77d5a-70dd-4530-b9bd-0ac74e7ee3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:36.318463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc77d5a-70dd-4530-b9bd-0ac74e7ee3ac admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:36.335372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1311/2585] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:36.337343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c07e-64c3-4522-a294-79111f332805 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:36.347630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c07e-64c3-4522-a294-79111f332805 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:36.353328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ab9b7-a1eb-47d3-8c2a-016aeaef3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:36.354014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ab9b7-a1eb-47d3-8c2a-016aeaef3e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:36.354283 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ab9b7-a1eb-47d3-8c2a-016aeaef3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:36.354557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ab9b7-a1eb-47d3-8c2a-016aeaef3e60 admin admin] PATH_INFO: `/v3/projects/2466188004a64705ba2e3eac2e9f4940/users/defa1e25cdbb469baddb509c77425385/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:36.356582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ab9b7-a1eb-47d3-8c2a-016aeaef3e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2466188004a64705ba2e3eac2e9f4940, user_id=defa1e25cdbb469baddb509c77425385, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:36.359291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ab9b7-a1eb-47d3-8c2a-016aeaef3e60 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:36.370473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1275/2586] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:36 2022] PUT /identity/v3/projects/2466188004a64705ba2e3eac2e9f4940/users/defa1e25cdbb469baddb509c77425385/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:36.381007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a571bc-4dde-4a76-9288-9584b8e0bb41 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:36.381311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a571bc-4dde-4a76-9288-9584b8e0bb41 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:36.381659 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a571bc-4dde-4a76-9288-9584b8e0bb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:36.410975 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-36a571bc-4dde-4a76-9288-9584b8e0bb41 None None] MFA Rules not processed for user `defa1e25cdbb469baddb509c77425385`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:36.413357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-36a571bc-4dde-4a76-9288-9584b8e0bb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:36.454180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:36.483350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1312/2587] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:36.494815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ab9b7-a1eb-47d3-8c2a-016aeaef3e60 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:36.550452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ab9b7-a1eb-47d3-8c2a-016aeaef3e60 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:36.554163 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c083c-6b95-4b99-b2c4-7d0728211618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:36.554754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c083c-6b95-4b99-b2c4-7d0728211618 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:36.555028 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c083c-6b95-4b99-b2c4-7d0728211618 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:36.555292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c083c-6b95-4b99-b2c4-7d0728211618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:36.564140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c083c-6b95-4b99-b2c4-7d0728211618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:36.565615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c083c-6b95-4b99-b2c4-7d0728211618 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:36.574740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1276/2588] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:36 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:36.896856 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a571bc-4dde-4a76-9288-9584b8e0bb41 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:36.898976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-36a571bc-4dde-4a76-9288-9584b8e0bb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:36.911595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a571bc-4dde-4a76-9288-9584b8e0bb41 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:36.915990 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa95be1-96f6-456f-9861-cf712e83df89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:36.917415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa95be1-96f6-456f-9861-cf712e83df89 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:36.917415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa95be1-96f6-456f-9861-cf712e83df89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:36.917415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa95be1-96f6-456f-9861-cf712e83df89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:36.976028 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa95be1-96f6-456f-9861-cf712e83df89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:36.977574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa95be1-96f6-456f-9861-cf712e83df89 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:36.986312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1313/2589] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:36 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:39.240168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c083c-6b95-4b99-b2c4-7d0728211618 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:39.241871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9e3c083c-6b95-4b99-b2c4-7d0728211618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:39.303241 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c083c-6b95-4b99-b2c4-7d0728211618 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:39.306984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c304-e5b2-4fe8-bc40-bb89cc2c3886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:39.307585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c304-e5b2-4fe8-bc40-bb89cc2c3886 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:39.307855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c304-e5b2-4fe8-bc40-bb89cc2c3886 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:39.308122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c304-e5b2-4fe8-bc40-bb89cc2c3886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:39.309983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-40e9c304-e5b2-4fe8-bc40-bb89cc2c3886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:39.342057 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:39.380070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9c304-e5b2-4fe8-bc40-bb89cc2c3886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:39.381321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9c304-e5b2-4fe8-bc40-bb89cc2c3886 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:39.392260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1277/2590] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:42.688252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa95be1-96f6-456f-9861-cf712e83df89 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:42.713820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa95be1-96f6-456f-9861-cf712e83df89 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:42.718682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:42.719802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:42.720322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:42.720806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] PATH_INFO: `/v3/users/cde7e6f5c3234482a19e1cdef6affaba` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:42.722769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde7e6f5c3234482a19e1cdef6affaba)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:42.729118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:42.999316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde7e6f5c3234482a19e1cdef6affaba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.000112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde7e6f5c3234482a19e1cdef6affaba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.000733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde7e6f5c3234482a19e1cdef6affaba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.095910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde7e6f5c3234482a19e1cdef6affaba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.109853 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde7e6f5c3234482a19e1cdef6affaba'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.128125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1314/2591] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:42 2022] DELETE /identity/v3/users/cde7e6f5c3234482a19e1cdef6affaba => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:43.132619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bdd7d-c211-4117-9ff8-ef53d044f96d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:43.133124 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bdd7d-c211-4117-9ff8-ef53d044f96d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:43.133222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bdd7d-c211-4117-9ff8-ef53d044f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:43.153291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fd7bdd7d-c211-4117-9ff8-ef53d044f96d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:43.154645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fd7bdd7d-c211-4117-9ff8-ef53d044f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:43.170130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:43.172631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:43.223988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1278/2592] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:43.231004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:43.238119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bdd7d-c211-4117-9ff8-ef53d044f96d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:43.239550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fd7bdd7d-c211-4117-9ff8-ef53d044f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:43.253358 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40701e-2af5-4c60-8b83-6811e1163bf3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:43.258375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:43.259594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:43.259940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:43.260213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:43.262903 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:43.274690 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:43.276751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:43.289396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1315/2593] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:43.301506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bdd7d-c211-4117-9ff8-ef53d044f96d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:43.305127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b266-fee2-4cef-81ba-2618a98a4922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:43.306295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b266-fee2-4cef-81ba-2618a98a4922 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:43.306572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b266-fee2-4cef-81ba-2618a98a4922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:43.306840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b266-fee2-4cef-81ba-2618a98a4922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:43.319394 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004b266-fee2-4cef-81ba-2618a98a4922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:43.320893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004b266-fee2-4cef-81ba-2618a98a4922 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:43.322047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:43.324267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:43.332561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1279/2594] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:43.339054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5e534-c1a0-491d-a917-de611092ffba service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:43.343749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:43.344379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:43.344665 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:43.344935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] PATH_INFO: `/v3/users/145c02717fc04c4aa81829de41470262` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:43.346091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145c02717fc04c4aa81829de41470262)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:43.348001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:43.567636 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145c02717fc04c4aa81829de41470262'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.569170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145c02717fc04c4aa81829de41470262'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.570591 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145c02717fc04c4aa81829de41470262'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.650024 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145c02717fc04c4aa81829de41470262'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.663420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145c02717fc04c4aa81829de41470262'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:43.677452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1316/2595] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:43 2022] DELETE /identity/v3/users/145c02717fc04c4aa81829de41470262 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:43.767151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b266-fee2-4cef-81ba-2618a98a4922 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:43.768640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0004b266-fee2-4cef-81ba-2618a98a4922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:43.786379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b266-fee2-4cef-81ba-2618a98a4922 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:43.862640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:43.863361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:43.863698 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:43.864035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] PATH_INFO: `/v3/projects/3c3fb5734e4243d5b5a145b64e3c42b7` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:43.865240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c3fb5734e4243d5b5a145b64e3c42b7)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:43.867482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:43.880906 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:44.006098 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:44.008145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:44.021210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c3fb5734e4243d5b5a145b64e3c42b7', 'request_id': 'req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.028299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c3fb5734e4243d5b5a145b64e3c42b7', 'request_id': 'req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.035505 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e07779-709f-43d4-a69c-bc24816e8b65 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:44.042270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c3fb5734e4243d5b5a145b64e3c42b7', 'request_id': 'req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.104287 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:44.105749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:44.105749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:44.105749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] PATH_INFO: `/v3/projects/013d6e97b2f54fdcb43e6a5ed6fb4a51` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:44.106932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=013d6e97b2f54fdcb43e6a5ed6fb4a51)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:44.108912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:44.130345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] The token cache is being invalidate because project 3c3fb5734e4243d5b5a145b64e3c42b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:44.131027 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.131522 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.137005 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1280/2596] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:43 2022] DELETE /identity/v3/projects/3c3fb5734e4243d5b5a145b64e3c42b7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:44.138038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:44.139382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:44.152316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa2ef2-c6f8-4bbe-9bbc-588418776e4e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:44.157051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:44.160212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:44.160212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:44.160212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] PATH_INFO: `/v3/users/defa1e25cdbb469baddb509c77425385` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:44.160212 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=defa1e25cdbb469baddb509c77425385)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:44.161228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:44.251540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013d6e97b2f54fdcb43e6a5ed6fb4a51', 'request_id': 'req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.252754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:44.257634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013d6e97b2f54fdcb43e6a5ed6fb4a51', 'request_id': 'req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.266529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013d6e97b2f54fdcb43e6a5ed6fb4a51', 'request_id': 'req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.344827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] The token cache is being invalidate because project 013d6e97b2f54fdcb43e6a5ed6fb4a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:44.345122 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.345762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99ff9e0e-5f68-49d4-80ff-5dc7b95c25b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.350641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1317/2597] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:44 2022] DELETE /identity/v3/projects/013d6e97b2f54fdcb43e6a5ed6fb4a51 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:44.352531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca321bc-bfc6-4878-8492-8246feac193c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:44.352880 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca321bc-bfc6-4878-8492-8246feac193c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:44.353211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca321bc-bfc6-4878-8492-8246feac193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:44.353659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defa1e25cdbb469baddb509c77425385'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.363136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defa1e25cdbb469baddb509c77425385'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.363860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defa1e25cdbb469baddb509c77425385'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.365047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defa1e25cdbb469baddb509c77425385'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.374605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6ca321bc-bfc6-4878-8492-8246feac193c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:44.375827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6ca321bc-bfc6-4878-8492-8246feac193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:44.434821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1318/2598] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:44.442712 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f6ed-9d06-40b7-8366-30362024429c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:44.443000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f6ed-9d06-40b7-8366-30362024429c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:44.443276 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f6ed-9d06-40b7-8366-30362024429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:44.444021 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defa1e25cdbb469baddb509c77425385'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:44.468755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1281/2599] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:44 2022] DELETE /identity/v3/users/defa1e25cdbb469baddb509c77425385 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:44.469066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0c86f6ed-9d06-40b7-8366-30362024429c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:44.470109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0c86f6ed-9d06-40b7-8366-30362024429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:44.543983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1319/2600] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:44.548194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:44.559136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6d1e-0957-4e9f-83b9-7f1c7f015d5e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:44.563964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199554f5-7f78-446c-b0ff-31c7dfb018d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:44.564679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199554f5-7f78-446c-b0ff-31c7dfb018d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:44.565018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199554f5-7f78-446c-b0ff-31c7dfb018d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:44.565349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199554f5-7f78-446c-b0ff-31c7dfb018d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:44.566109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199554f5-7f78-446c-b0ff-31c7dfb018d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:44.566406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199554f5-7f78-446c-b0ff-31c7dfb018d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:44.568000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199554f5-7f78-446c-b0ff-31c7dfb018d5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:44.581620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1282/2601] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:44.586170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f6ed-9d06-40b7-8366-30362024429c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:44.596402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f6ed-9d06-40b7-8366-30362024429c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:44.601579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8b32-9f41-45e9-a944-3ba29022afed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:44.602249 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8b32-9f41-45e9-a944-3ba29022afed admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:44.602816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8b32-9f41-45e9-a944-3ba29022afed admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:44.603117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8b32-9f41-45e9-a944-3ba29022afed admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:44.603762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8b32-9f41-45e9-a944-3ba29022afed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:44.605902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8b32-9f41-45e9-a944-3ba29022afed admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:44.708766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1320/2602] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:44 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:44.713059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199554f5-7f78-446c-b0ff-31c7dfb018d5 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:44.724827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199554f5-7f78-446c-b0ff-31c7dfb018d5 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:44.792618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:44.798494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89600518-c194-40a5-9356-dd20ed2a376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:44.799119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600518-c194-40a5-9356-dd20ed2a376c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:44.799999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600518-c194-40a5-9356-dd20ed2a376c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:44.799999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89600518-c194-40a5-9356-dd20ed2a376c admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:44.800263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89600518-c194-40a5-9356-dd20ed2a376c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:44.802218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89600518-c194-40a5-9356-dd20ed2a376c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:44.924129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1283/2603] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:44 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:44.928116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8b32-9f41-45e9-a944-3ba29022afed admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:44.941697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8b32-9f41-45e9-a944-3ba29022afed admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:44.946619 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25a1a-5aad-4ac0-a0db-195f4ce56d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:44.947231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25a1a-5aad-4ac0-a0db-195f4ce56d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:44.947512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25a1a-5aad-4ac0-a0db-195f4ce56d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:44.948155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25a1a-5aad-4ac0-a0db-195f4ce56d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:44.948500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b25a1a-5aad-4ac0-a0db-195f4ce56d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:44.950138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b25a1a-5aad-4ac0-a0db-195f4ce56d95 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:44.960739 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1321/2604] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:44.971068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89600518-c194-40a5-9356-dd20ed2a376c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:44.982133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89600518-c194-40a5-9356-dd20ed2a376c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:44.986826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72956e2-1846-4d63-beda-92749100cba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:44.987419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72956e2-1846-4d63-beda-92749100cba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:44.987693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72956e2-1846-4d63-beda-92749100cba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:44.988046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72956e2-1846-4d63-beda-92749100cba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:44.988770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72956e2-1846-4d63-beda-92749100cba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:44.990375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72956e2-1846-4d63-beda-92749100cba9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.001991 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1284/2605] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:45.006278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25a1a-5aad-4ac0-a0db-195f4ce56d95 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.016595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25a1a-5aad-4ac0-a0db-195f4ce56d95 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.021717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d74ef-8878-4009-bfbe-a61ef387e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.022377 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d74ef-8878-4009-bfbe-a61ef387e884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.022651 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d74ef-8878-4009-bfbe-a61ef387e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.022921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d74ef-8878-4009-bfbe-a61ef387e884 admin admin] PATH_INFO: `/v3/projects/d43de09c947b4e2d8d7e0edaf9b56b5d/users/0756aeb81588498794f8a94fdaa3cb58/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.038691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d74ef-8878-4009-bfbe-a61ef387e884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43de09c947b4e2d8d7e0edaf9b56b5d, user_id=0756aeb81588498794f8a94fdaa3cb58, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.047290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d74ef-8878-4009-bfbe-a61ef387e884 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.166382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1322/2606] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:45 2022] PUT /identity/v3/projects/d43de09c947b4e2d8d7e0edaf9b56b5d/users/0756aeb81588498794f8a94fdaa3cb58/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:45.166731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72956e2-1846-4d63-beda-92749100cba9 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.166731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d72956e2-1846-4d63-beda-92749100cba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:45.170500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7d3de-be52-4893-8255-b36a4c0f908b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.170871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7d3de-be52-4893-8255-b36a4c0f908b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.171156 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7d3de-be52-4893-8255-b36a4c0f908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.179868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72956e2-1846-4d63-beda-92749100cba9 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.204182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6ab7d3de-be52-4893-8255-b36a4c0f908b None None] MFA Rules not processed for user `0756aeb81588498794f8a94fdaa3cb58`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:45.205401 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6ab7d3de-be52-4893-8255-b36a4c0f908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:45.215981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:45.254134 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.254824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.255103 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.255378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] PATH_INFO: `/v3/projects/2466188004a64705ba2e3eac2e9f4940` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.256547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2466188004a64705ba2e3eac2e9f4940)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.258597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.275953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1323/2607] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:45.280798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7d3de-be52-4893-8255-b36a4c0f908b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.292780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7d3de-be52-4893-8255-b36a4c0f908b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.297957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25acf6-0d7d-49e8-8d80-aae0acddd1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.298546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25acf6-0d7d-49e8-8d80-aae0acddd1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.298822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25acf6-0d7d-49e8-8d80-aae0acddd1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.299091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25acf6-0d7d-49e8-8d80-aae0acddd1b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.303334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25acf6-0d7d-49e8-8d80-aae0acddd1b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.303334 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25acf6-0d7d-49e8-8d80-aae0acddd1b5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.392009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1324/2608] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:45 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:45.393005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25acf6-0d7d-49e8-8d80-aae0acddd1b5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.405143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2466188004a64705ba2e3eac2e9f4940', 'request_id': 'req-bb740aca-0d6d-416e-98b5-55d8770a7010'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:45.410765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2466188004a64705ba2e3eac2e9f4940', 'request_id': 'req-bb740aca-0d6d-416e-98b5-55d8770a7010'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:45.417725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2466188004a64705ba2e3eac2e9f4940', 'request_id': 'req-bb740aca-0d6d-416e-98b5-55d8770a7010'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:45.457079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25acf6-0d7d-49e8-8d80-aae0acddd1b5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.462402 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b728ad-1779-4fd0-bbd9-05784a1f18bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.463185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b728ad-1779-4fd0-bbd9-05784a1f18bb admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.463461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b728ad-1779-4fd0-bbd9-05784a1f18bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.463725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b728ad-1779-4fd0-bbd9-05784a1f18bb admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.464341 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b728ad-1779-4fd0-bbd9-05784a1f18bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.466357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b728ad-1779-4fd0-bbd9-05784a1f18bb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.512465 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] The token cache is being invalidate because project 2466188004a64705ba2e3eac2e9f4940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:45.512757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:45.513396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb740aca-0d6d-416e-98b5-55d8770a7010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:45.514935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1285/2609] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:45 2022] DELETE /identity/v3/projects/2466188004a64705ba2e3eac2e9f4940 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:45.519833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c0894-e998-4107-b9e9-1a1827e382cf None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.520112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c0894-e998-4107-b9e9-1a1827e382cf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.520374 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c0894-e998-4107-b9e9-1a1827e382cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.541489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e09c0894-e998-4107-b9e9-1a1827e382cf None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:45.542695 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e09c0894-e998-4107-b9e9-1a1827e382cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:45.550574 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1286/2610] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:45.559805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2de60-cb0a-4de0-95e4-2900ccaedb35 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.560082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2de60-cb0a-4de0-95e4-2900ccaedb35 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.560802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2de60-cb0a-4de0-95e4-2900ccaedb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.581298 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c6e2de60-cb0a-4de0-95e4-2900ccaedb35 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:45.582489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1325/2611] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:45 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:45.584419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c6e2de60-cb0a-4de0-95e4-2900ccaedb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:45.594078 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b728ad-1779-4fd0-bbd9-05784a1f18bb admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.594518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1287/2612] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:45.598508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2de60-cb0a-4de0-95e4-2900ccaedb35 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.599380 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-30b728ad-1779-4fd0-bbd9-05784a1f18bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:45.608702 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2de60-cb0a-4de0-95e4-2900ccaedb35 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.612961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b728ad-1779-4fd0-bbd9-05784a1f18bb admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.617117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d03e6-f969-412f-9491-a08cf4f245c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.618925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d03e6-f969-412f-9491-a08cf4f245c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.619057 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ad4bf-eb2f-42a0-bfeb-cc8e2523996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.621559 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d03e6-f969-412f-9491-a08cf4f245c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.621696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ad4bf-eb2f-42a0-bfeb-cc8e2523996f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.621804 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d03e6-f969-412f-9491-a08cf4f245c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.621896 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ad4bf-eb2f-42a0-bfeb-cc8e2523996f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.621896 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ad4bf-eb2f-42a0-bfeb-cc8e2523996f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.622070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d03e6-f969-412f-9491-a08cf4f245c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:45.622169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ad4bf-eb2f-42a0-bfeb-cc8e2523996f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.622260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d03e6-f969-412f-9491-a08cf4f245c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.622841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ad4bf-eb2f-42a0-bfeb-cc8e2523996f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.622957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d03e6-f969-412f-9491-a08cf4f245c6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.639216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1326/2613] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:45.640490 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1288/2614] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:10:45.643462 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d03e6-f969-412f-9491-a08cf4f245c6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.650179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ad4bf-eb2f-42a0-bfeb-cc8e2523996f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.656456 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d03e6-f969-412f-9491-a08cf4f245c6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.658169 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ad4bf-eb2f-42a0-bfeb-cc8e2523996f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.664589 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0b54b-3d4f-450e-91ee-11ca6be21e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.664916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba116b-43e0-4c8f-a49e-a7fb4465c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.665394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0b54b-3d4f-450e-91ee-11ca6be21e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.665539 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba116b-43e0-4c8f-a49e-a7fb4465c51c admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.665710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0b54b-3d4f-450e-91ee-11ca6be21e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.665813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba116b-43e0-4c8f-a49e-a7fb4465c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.665983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0b54b-3d4f-450e-91ee-11ca6be21e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.666082 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba116b-43e0-4c8f-a49e-a7fb4465c51c admin admin] PATH_INFO: `/v3/projects/d3a215a13a7548d195f30917912dcbfc/users/6df7f9150c54499881022b15343caaa3/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.666594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0b54b-3d4f-450e-91ee-11ca6be21e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.668830 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0b54b-3d4f-450e-91ee-11ca6be21e03 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.682036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba116b-43e0-4c8f-a49e-a7fb4465c51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a215a13a7548d195f30917912dcbfc, user_id=6df7f9150c54499881022b15343caaa3, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.684803 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba116b-43e0-4c8f-a49e-a7fb4465c51c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.797501 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1327/2615] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:45 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:45.801753 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0b54b-3d4f-450e-91ee-11ca6be21e03 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.834135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1289/2616] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:45 2022] PUT /identity/v3/projects/d3a215a13a7548d195f30917912dcbfc/users/6df7f9150c54499881022b15343caaa3/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:45.839446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba116b-43e0-4c8f-a49e-a7fb4465c51c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.860341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:45.909395 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba116b-43e0-4c8f-a49e-a7fb4465c51c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.914488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a1ed9-c36e-4a31-87e5-419a58194aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.915475 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a1ed9-c36e-4a31-87e5-419a58194aee admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.915751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a1ed9-c36e-4a31-87e5-419a58194aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.916014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a1ed9-c36e-4a31-87e5-419a58194aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.916670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a1ed9-c36e-4a31-87e5-419a58194aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.918346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a1ed9-c36e-4a31-87e5-419a58194aee admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.929074 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1290/2617] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:45.933710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a1ed9-c36e-4a31-87e5-419a58194aee admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:45.943941 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a1ed9-c36e-4a31-87e5-419a58194aee admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:45.949914 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeabb4b-0d3b-4493-b7ca-e516b0b0fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:45.950582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeabb4b-0d3b-4493-b7ca-e516b0b0fb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.950855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeabb4b-0d3b-4493-b7ca-e516b0b0fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.951122 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeabb4b-0d3b-4493-b7ca-e516b0b0fb23 admin admin] PATH_INFO: `/v3/projects/d3a215a13a7548d195f30917912dcbfc/users/6df7f9150c54499881022b15343caaa3/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.953896 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeabb4b-0d3b-4493-b7ca-e516b0b0fb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a215a13a7548d195f30917912dcbfc, user_id=6df7f9150c54499881022b15343caaa3, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:45.956608 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeabb4b-0d3b-4493-b7ca-e516b0b0fb23 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:45.972311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1291/2618] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:45 2022] PUT /identity/v3/projects/d3a215a13a7548d195f30917912dcbfc/users/6df7f9150c54499881022b15343caaa3/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:45.984747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efa6fd-b4df-4076-9152-17f9860f0db0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:45.985795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efa6fd-b4df-4076-9152-17f9860f0db0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:45.986178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efa6fd-b4df-4076-9152-17f9860f0db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:45.992428 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:46.012267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0b54b-3d4f-450e-91ee-11ca6be21e03 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.018238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-77efa6fd-b4df-4076-9152-17f9860f0db0 None None] MFA Rules not processed for user `6df7f9150c54499881022b15343caaa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:46.019552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77efa6fd-b4df-4076-9152-17f9860f0db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:46.067945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6424add-6fb0-4b65-b9da-ddc57aeb1669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.068597 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6424add-6fb0-4b65-b9da-ddc57aeb1669 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.068865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6424add-6fb0-4b65-b9da-ddc57aeb1669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.069139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6424add-6fb0-4b65-b9da-ddc57aeb1669 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.069804 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6424add-6fb0-4b65-b9da-ddc57aeb1669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.073134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6424add-6fb0-4b65-b9da-ddc57aeb1669 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:46.090873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1292/2619] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:46.102795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efa6fd-b4df-4076-9152-17f9860f0db0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:46.108415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77efa6fd-b4df-4076-9152-17f9860f0db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:46.160783 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efa6fd-b4df-4076-9152-17f9860f0db0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.164430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431baec7-1c4b-46db-8ba6-59afa5f3da5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.165055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431baec7-1c4b-46db-8ba6-59afa5f3da5f service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.165335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431baec7-1c4b-46db-8ba6-59afa5f3da5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.165640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431baec7-1c4b-46db-8ba6-59afa5f3da5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.174538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431baec7-1c4b-46db-8ba6-59afa5f3da5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.175994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431baec7-1c4b-46db-8ba6-59afa5f3da5f service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:46.185996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1293/2620] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:46.195883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1328/2621] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:45 2022] POST /identity/v3/users => generated 284 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:46.197645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431baec7-1c4b-46db-8ba6-59afa5f3da5f service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:46.213402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431baec7-1c4b-46db-8ba6-59afa5f3da5f service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.218822 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb07094-5e15-4b74-9758-bf9a2cbe8833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.219424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb07094-5e15-4b74-9758-bf9a2cbe8833 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.219772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb07094-5e15-4b74-9758-bf9a2cbe8833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.220003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb07094-5e15-4b74-9758-bf9a2cbe8833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.220643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb07094-5e15-4b74-9758-bf9a2cbe8833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.222277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb07094-5e15-4b74-9758-bf9a2cbe8833 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:46.232776 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1294/2622] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:46.237189 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6424add-6fb0-4b65-b9da-ddc57aeb1669 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:46.254946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6424add-6fb0-4b65-b9da-ddc57aeb1669 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.260911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fff6c-1d3d-4652-b1c3-eebe1d4dd3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.261534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fff6c-1d3d-4652-b1c3-eebe1d4dd3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.261808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fff6c-1d3d-4652-b1c3-eebe1d4dd3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.262071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fff6c-1d3d-4652-b1c3-eebe1d4dd3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.262708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fff6c-1d3d-4652-b1c3-eebe1d4dd3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.264265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fff6c-1d3d-4652-b1c3-eebe1d4dd3b3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:46.275832 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1329/2623] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:46.281118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb07094-5e15-4b74-9758-bf9a2cbe8833 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:46.290054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fff6c-1d3d-4652-b1c3-eebe1d4dd3b3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:46.291762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1c2fff6c-1d3d-4652-b1c3-eebe1d4dd3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:46.292872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb07094-5e15-4b74-9758-bf9a2cbe8833 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.297512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4855ebd-6c09-4df8-8932-bd73d5a8993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.298198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4855ebd-6c09-4df8-8932-bd73d5a8993f admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.301148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4855ebd-6c09-4df8-8932-bd73d5a8993f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.301148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4855ebd-6c09-4df8-8932-bd73d5a8993f admin admin] PATH_INFO: `/v3/projects/2ae23e2c35b5466cb80f247c53683ba0/users/f5582000d8634b318dae0384c822beac/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.304005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fff6c-1d3d-4652-b1c3-eebe1d4dd3b3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.308457 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaf52a-225d-42fd-8183-ec972211ae46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.309568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf52a-225d-42fd-8183-ec972211ae46 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.309849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf52a-225d-42fd-8183-ec972211ae46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.310125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf52a-225d-42fd-8183-ec972211ae46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.311846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-44aaf52a-225d-42fd-8183-ec972211ae46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:46.312445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:46.315521 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4855ebd-6c09-4df8-8932-bd73d5a8993f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae23e2c35b5466cb80f247c53683ba0, user_id=f5582000d8634b318dae0384c822beac, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.318287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4855ebd-6c09-4df8-8932-bd73d5a8993f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:46.375044 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaf52a-225d-42fd-8183-ec972211ae46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.376460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaf52a-225d-42fd-8183-ec972211ae46 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:46.385881 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1330/2624] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:46.419741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1295/2625] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:46 2022] PUT /identity/v3/projects/2ae23e2c35b5466cb80f247c53683ba0/users/f5582000d8634b318dae0384c822beac/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:46.431673 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cdfc0-4dda-45d2-9a6d-94399deeb906 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.431955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cdfc0-4dda-45d2-9a6d-94399deeb906 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.432220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cdfc0-4dda-45d2-9a6d-94399deeb906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.459173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ac4cdfc0-4dda-45d2-9a6d-94399deeb906 None None] MFA Rules not processed for user `f5582000d8634b318dae0384c822beac`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:46.460382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ac4cdfc0-4dda-45d2-9a6d-94399deeb906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:46.526220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:46.530128 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1331/2626] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:46.535190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4855ebd-6c09-4df8-8932-bd73d5a8993f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:46.596700 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4855ebd-6c09-4df8-8932-bd73d5a8993f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.601190 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e300414-06d0-4fa9-8569-22decc927393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.601824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e300414-06d0-4fa9-8569-22decc927393 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.602607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e300414-06d0-4fa9-8569-22decc927393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.602881 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e300414-06d0-4fa9-8569-22decc927393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.603513 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e300414-06d0-4fa9-8569-22decc927393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.605406 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e300414-06d0-4fa9-8569-22decc927393 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:46.714687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1296/2627] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:46 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:46.715754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cdfc0-4dda-45d2-9a6d-94399deeb906 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:46.726635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cdfc0-4dda-45d2-9a6d-94399deeb906 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.785366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdee99e-cc2b-49a7-9d31-f8ceeb3b020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.786048 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdee99e-cc2b-49a7-9d31-f8ceeb3b020b admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.786326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdee99e-cc2b-49a7-9d31-f8ceeb3b020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.786594 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdee99e-cc2b-49a7-9d31-f8ceeb3b020b admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.787217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdee99e-cc2b-49a7-9d31-f8ceeb3b020b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.789106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdee99e-cc2b-49a7-9d31-f8ceeb3b020b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:46.909072 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1332/2628] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:46 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:46.912907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e300414-06d0-4fa9-8569-22decc927393 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:46.924107 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e300414-06d0-4fa9-8569-22decc927393 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.928851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc663-e689-4b5e-9eac-ab1cf585182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.929448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc663-e689-4b5e-9eac-ab1cf585182e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.929966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc663-e689-4b5e-9eac-ab1cf585182e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.930077 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc663-e689-4b5e-9eac-ab1cf585182e admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.931643 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc663-e689-4b5e-9eac-ab1cf585182e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.933268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc663-e689-4b5e-9eac-ab1cf585182e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:46.953066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1297/2629] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:46.957458 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdee99e-cc2b-49a7-9d31-f8ceeb3b020b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:46.967713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdee99e-cc2b-49a7-9d31-f8ceeb3b020b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:46.972014 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c7b9f-6367-44a8-96e4-5869c536d3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:46.972652 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c7b9f-6367-44a8-96e4-5869c536d3be admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:46.972924 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c7b9f-6367-44a8-96e4-5869c536d3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:46.973188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c7b9f-6367-44a8-96e4-5869c536d3be admin admin] PATH_INFO: `/v3/projects/31d5b38c142a4d65a46a3effd835005d/users/f9e23454efae42ee8a7d6222c0e5ce03/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:46.988311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c7b9f-6367-44a8-96e4-5869c536d3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d5b38c142a4d65a46a3effd835005d, user_id=f9e23454efae42ee8a7d6222c0e5ce03, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:46.990987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c7b9f-6367-44a8-96e4-5869c536d3be admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:47.128355 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1333/2630] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:46 2022] PUT /identity/v3/projects/31d5b38c142a4d65a46a3effd835005d/users/f9e23454efae42ee8a7d6222c0e5ce03/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:47.129736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc663-e689-4b5e-9eac-ab1cf585182e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:47.143394 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc663-e689-4b5e-9eac-ab1cf585182e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:47.203068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290c592-9bbb-4eec-a3a3-3d9ecf7621a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:47.203723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290c592-9bbb-4eec-a3a3-3d9ecf7621a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.203934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290c592-9bbb-4eec-a3a3-3d9ecf7621a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.204202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290c592-9bbb-4eec-a3a3-3d9ecf7621a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.204844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290c592-9bbb-4eec-a3a3-3d9ecf7621a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:47.206589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290c592-9bbb-4eec-a3a3-3d9ecf7621a9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:47.216508 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1298/2631] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:47.220819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c7b9f-6367-44a8-96e4-5869c536d3be admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:47.233446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c7b9f-6367-44a8-96e4-5869c536d3be admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:47.238859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e747e5-be3f-4377-bc35-c8b1b86efdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:47.239516 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e747e5-be3f-4377-bc35-c8b1b86efdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.239793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e747e5-be3f-4377-bc35-c8b1b86efdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.240112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e747e5-be3f-4377-bc35-c8b1b86efdb0 admin admin] PATH_INFO: `/v3/projects/31d5b38c142a4d65a46a3effd835005d/users/f9e23454efae42ee8a7d6222c0e5ce03/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.242427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e747e5-be3f-4377-bc35-c8b1b86efdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d5b38c142a4d65a46a3effd835005d, user_id=f9e23454efae42ee8a7d6222c0e5ce03, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:47.243706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290c592-9bbb-4eec-a3a3-3d9ecf7621a9 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:47.246052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7290c592-9bbb-4eec-a3a3-3d9ecf7621a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:47.246190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e747e5-be3f-4377-bc35-c8b1b86efdb0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:47.261524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1334/2632] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:47 2022] PUT /identity/v3/projects/31d5b38c142a4d65a46a3effd835005d/users/f9e23454efae42ee8a7d6222c0e5ce03/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:47.261815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290c592-9bbb-4eec-a3a3-3d9ecf7621a9 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:47.273895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21e6d-6625-4ceb-83ec-30b02d1a6e0f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.274362 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21e6d-6625-4ceb-83ec-30b02d1a6e0f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.274758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21e6d-6625-4ceb-83ec-30b02d1a6e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.310498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f4a21e6d-6625-4ceb-83ec-30b02d1a6e0f None None] MFA Rules not processed for user `f9e23454efae42ee8a7d6222c0e5ce03`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:47.311718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f4a21e6d-6625-4ceb-83ec-30b02d1a6e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:47.330861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:47.331519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.331797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.332068 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] PATH_INFO: `/v3/users/f98534ac3d7e461f9002390816cc2bf4` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.333205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98534ac3d7e461f9002390816cc2bf4)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:47.335270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:47.337602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:47.396148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1335/2633] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:47.396934 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21e6d-6625-4ceb-83ec-30b02d1a6e0f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:47.398232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f4a21e6d-6625-4ceb-83ec-30b02d1a6e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:47.433008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:47.468154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21e6d-6625-4ceb-83ec-30b02d1a6e0f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:47.472809 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:47.473432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.473749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.474016 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] PATH_INFO: `/v3/users/3e84e80d65284ca59b78b229eb399edf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.475214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e84e80d65284ca59b78b229eb399edf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:47.477730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:47.546448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98534ac3d7e461f9002390816cc2bf4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.553278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98534ac3d7e461f9002390816cc2bf4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.554012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98534ac3d7e461f9002390816cc2bf4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.554599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98534ac3d7e461f9002390816cc2bf4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.646701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98534ac3d7e461f9002390816cc2bf4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.665362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1299/2634] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:47 2022] DELETE /identity/v3/users/f98534ac3d7e461f9002390816cc2bf4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:47.666176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:47.667489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:47.695099 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e84e80d65284ca59b78b229eb399edf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.695787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e84e80d65284ca59b78b229eb399edf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.696556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e84e80d65284ca59b78b229eb399edf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.742665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826d779-779a-4290-a1d8-8a75dd8603e9 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:47.746370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a096cb5-f2f9-4dc6-bb6a-c8a489d7c87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:47.746959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a096cb5-f2f9-4dc6-bb6a-c8a489d7c87e service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.747229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a096cb5-f2f9-4dc6-bb6a-c8a489d7c87e service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.747492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a096cb5-f2f9-4dc6-bb6a-c8a489d7c87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.749387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3a096cb5-f2f9-4dc6-bb6a-c8a489d7c87e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:47.769816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e84e80d65284ca59b78b229eb399edf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.782480 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4858bdd1-de20-4a02-8cc7-31b8660ad0fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e84e80d65284ca59b78b229eb399edf'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:47.795640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1336/2635] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:47 2022] DELETE /identity/v3/users/3e84e80d65284ca59b78b229eb399edf => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:47.798973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf215b8-7d58-403a-952b-f9c9a992c9cf None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.798973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf215b8-7d58-403a-952b-f9c9a992c9cf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.798973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf215b8-7d58-403a-952b-f9c9a992c9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.812187 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a096cb5-f2f9-4dc6-bb6a-c8a489d7c87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:47.813648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a096cb5-f2f9-4dc6-bb6a-c8a489d7c87e service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:47.824254 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1300/2636] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:47.825344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb32cc-afe8-4f11-a99d-fb66ba277374 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.825680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb32cc-afe8-4f11-a99d-fb66ba277374 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.825954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb32cc-afe8-4f11-a99d-fb66ba277374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.826565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7cf215b8-7d58-403a-952b-f9c9a992c9cf None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:47.827746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7cf215b8-7d58-403a-952b-f9c9a992c9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:47.846782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b3eb32cc-afe8-4f11-a99d-fb66ba277374 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:47.848013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b3eb32cc-afe8-4f11-a99d-fb66ba277374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:47.853797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:47.890246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1337/2637] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:47.901350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf215b8-7d58-403a-952b-f9c9a992c9cf None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:47.902714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7cf215b8-7d58-403a-952b-f9c9a992c9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:47.906710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1301/2638] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:47.916509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb32cc-afe8-4f11-a99d-fb66ba277374 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:47.918196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b3eb32cc-afe8-4f11-a99d-fb66ba277374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:47.956912 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:47.969166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf215b8-7d58-403a-952b-f9c9a992c9cf None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:47.972829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5203-08c6-4fb0-b363-265aa3e4e6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:47.973432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5203-08c6-4fb0-b363-265aa3e4e6da service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.973737 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5203-08c6-4fb0-b363-265aa3e4e6da service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.974006 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5203-08c6-4fb0-b363-265aa3e4e6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.977228 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb32cc-afe8-4f11-a99d-fb66ba277374 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:47.980824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136d9ff-500d-4a3f-9bb4-245d9b87bfc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:47.981589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136d9ff-500d-4a3f-9bb4-245d9b87bfc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:47.981861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136d9ff-500d-4a3f-9bb4-245d9b87bfc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:47.982133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136d9ff-500d-4a3f-9bb4-245d9b87bfc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:47.983211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba5203-08c6-4fb0-b363-265aa3e4e6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:47.984631 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba5203-08c6-4fb0-b363-265aa3e4e6da service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:47.991627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136d9ff-500d-4a3f-9bb4-245d9b87bfc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:47.994219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136d9ff-500d-4a3f-9bb4-245d9b87bfc2 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:47.994584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1338/2639] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:48.004412 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1302/2640] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:48.073329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5203-08c6-4fb0-b363-265aa3e4e6da service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:48.074893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2eba5203-08c6-4fb0-b363-265aa3e4e6da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:48.136125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5203-08c6-4fb0-b363-265aa3e4e6da service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:48.139858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:48.140459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:48.141101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:48.141101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:48.142770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:48.203059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:48.204531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:48.214283 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1339/2641] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:48.512516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136d9ff-500d-4a3f-9bb4-245d9b87bfc2 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:48.514997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9136d9ff-500d-4a3f-9bb4-245d9b87bfc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:48.528736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136d9ff-500d-4a3f-9bb4-245d9b87bfc2 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:48.533688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:48.534322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:48.534635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:48.534862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] PATH_INFO: `/v3/projects/3c1d8979c5cb4a4c80f380e1365c7fbe` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:48.535986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1d8979c5cb4a4c80f380e1365c7fbe)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:48.538164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:48.578489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:48.578489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:48.609812 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0720c-b040-4abd-a19a-24453322efd0 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:48.627522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:48.628203 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:48.628484 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:48.628764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] PATH_INFO: `/v3/projects/81113b71fa3f45629f85dafacb89f519` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:48.635632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81113b71fa3f45629f85dafacb89f519)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:48.635632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:48.644123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1d8979c5cb4a4c80f380e1365c7fbe', 'request_id': 'req-cfcc8481-71e8-4ff4-b398-644a4c3c457d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.650905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1d8979c5cb4a4c80f380e1365c7fbe', 'request_id': 'req-cfcc8481-71e8-4ff4-b398-644a4c3c457d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.657558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1d8979c5cb4a4c80f380e1365c7fbe', 'request_id': 'req-cfcc8481-71e8-4ff4-b398-644a4c3c457d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.750147 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] The token cache is being invalidate because project 3c1d8979c5cb4a4c80f380e1365c7fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:48.750717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.751794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.754511 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1303/2642] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:48 2022] DELETE /identity/v3/projects/3c1d8979c5cb4a4c80f380e1365c7fbe => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:48.758867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:48.760582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:48.762149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81113b71fa3f45629f85dafacb89f519', 'request_id': 'req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.768440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81113b71fa3f45629f85dafacb89f519', 'request_id': 'req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.775713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81113b71fa3f45629f85dafacb89f519', 'request_id': 'req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.802204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:48.823387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc8481-71e8-4ff4-b398-644a4c3c457d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:48.876444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:48.877067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:48.877339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:48.877637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] PATH_INFO: `/v3/users/490faa176bcb4c8f8c07f7ae66f08a48` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:48.878754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] RBAC: Authorizing `identity:delete_user(user_id=490faa176bcb4c8f8c07f7ae66f08a48)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:48.880648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:48.912187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] The token cache is being invalidate because project 81113b71fa3f45629f85dafacb89f519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:48.912554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.913238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.915317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1340/2643] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:48 2022] DELETE /identity/v3/projects/81113b71fa3f45629f85dafacb89f519 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:49.094860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490faa176bcb4c8f8c07f7ae66f08a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:49.104140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490faa176bcb4c8f8c07f7ae66f08a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:49.105038 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490faa176bcb4c8f8c07f7ae66f08a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:49.106217 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490faa176bcb4c8f8c07f7ae66f08a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:49.283966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1c3c6c90-014e-4635-bc97-5597138b60be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490faa176bcb4c8f8c07f7ae66f08a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:49.302266 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1304/2644] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:48 2022] DELETE /identity/v3/users/490faa176bcb4c8f8c07f7ae66f08a48 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:49.729349 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:49.734812 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:49.745766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e92c35-7f6a-4cd8-b3e6-0f1653d597e9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:49.766210 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:49.807191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:49.807822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:49.808102 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:49.808373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] PATH_INFO: `/v3/projects/71109fc4a94e47bdbbac753269a5ea92` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:49.809507 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71109fc4a94e47bdbbac753269a5ea92)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:49.811416 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:49.952697 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71109fc4a94e47bdbbac753269a5ea92', 'request_id': 'req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:49.958218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71109fc4a94e47bdbbac753269a5ea92', 'request_id': 'req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:49.964951 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71109fc4a94e47bdbbac753269a5ea92', 'request_id': 'req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:50.078096 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] The token cache is being invalidate because project 71109fc4a94e47bdbbac753269a5ea92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:50.078383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:50.079031 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9dbf9110-e70e-4be6-bac4-2be34ffa5ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:50.080519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1341/2645] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:49 2022] DELETE /identity/v3/projects/71109fc4a94e47bdbbac753269a5ea92 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:50.085398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6045b4c-563e-429b-bfec-1d4cd4d96181 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.085935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6045b4c-563e-429b-bfec-1d4cd4d96181 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.086051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6045b4c-563e-429b-bfec-1d4cd4d96181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.142597 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d6045b4c-563e-429b-bfec-1d4cd4d96181 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:50.143840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d6045b4c-563e-429b-bfec-1d4cd4d96181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:50.208126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1305/2646] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:50.216889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b665a-e595-47c6-aa8d-b3999b768e71 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.218441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b665a-e595-47c6-aa8d-b3999b768e71 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.218441 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b665a-e595-47c6-aa8d-b3999b768e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.239086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2f0b665a-e595-47c6-aa8d-b3999b768e71 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:50.240288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2f0b665a-e595-47c6-aa8d-b3999b768e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:50.248703 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1342/2647] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:50.253286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6045b4c-563e-429b-bfec-1d4cd4d96181 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:50.263293 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6045b4c-563e-429b-bfec-1d4cd4d96181 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:50.267779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc44681-6a73-4794-84df-4449c12cf8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:50.275827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc44681-6a73-4794-84df-4449c12cf8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.275827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc44681-6a73-4794-84df-4449c12cf8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.275827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc44681-6a73-4794-84df-4449c12cf8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.275827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc44681-6a73-4794-84df-4449c12cf8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:50.275827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc44681-6a73-4794-84df-4449c12cf8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:50.275827 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc44681-6a73-4794-84df-4449c12cf8a3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:50.283237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1306/2648] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:50.287552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b665a-e595-47c6-aa8d-b3999b768e71 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:50.295625 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:50.297056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b665a-e595-47c6-aa8d-b3999b768e71 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:50.301793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072da9e-3571-417b-9f82-e03d7e15d673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:50.302384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072da9e-3571-417b-9f82-e03d7e15d673 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.310367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072da9e-3571-417b-9f82-e03d7e15d673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.310367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072da9e-3571-417b-9f82-e03d7e15d673 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.310367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072da9e-3571-417b-9f82-e03d7e15d673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:50.310367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072da9e-3571-417b-9f82-e03d7e15d673 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:50.393798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1343/2649] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:50 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:50.400889 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc44681-6a73-4794-84df-4449c12cf8a3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:50.409135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc44681-6a73-4794-84df-4449c12cf8a3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:50.466538 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9bb79-a8db-4e1e-ab5a-0f096e8ab7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:50.467138 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9bb79-a8db-4e1e-ab5a-0f096e8ab7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.467411 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9bb79-a8db-4e1e-ab5a-0f096e8ab7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.467677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9bb79-a8db-4e1e-ab5a-0f096e8ab7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.468302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9bb79-a8db-4e1e-ab5a-0f096e8ab7a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:50.470229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9bb79-a8db-4e1e-ab5a-0f096e8ab7a6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:50.617775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1307/2650] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:50 2022] POST /identity/v3/users => generated 282 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:50.621500 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072da9e-3571-417b-9f82-e03d7e15d673 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:50.632805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072da9e-3571-417b-9f82-e03d7e15d673 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:50.638422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251723e1-5631-447c-9532-7ff0cc654023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:50.639047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251723e1-5631-447c-9532-7ff0cc654023 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.639323 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251723e1-5631-447c-9532-7ff0cc654023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.639592 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251723e1-5631-447c-9532-7ff0cc654023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.640229 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251723e1-5631-447c-9532-7ff0cc654023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:50.641840 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251723e1-5631-447c-9532-7ff0cc654023 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:50.653241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1344/2651] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:50.657677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9bb79-a8db-4e1e-ab5a-0f096e8ab7a6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:50.668020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9bb79-a8db-4e1e-ab5a-0f096e8ab7a6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:50.672671 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3b648-13d7-4915-8245-5e93d41aca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:50.673263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3b648-13d7-4915-8245-5e93d41aca2e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.673662 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3b648-13d7-4915-8245-5e93d41aca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.673936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3b648-13d7-4915-8245-5e93d41aca2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.674575 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3b648-13d7-4915-8245-5e93d41aca2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:50.676153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3b648-13d7-4915-8245-5e93d41aca2e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:50.698112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1308/2652] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:50.704135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251723e1-5631-447c-9532-7ff0cc654023 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:50.718558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251723e1-5631-447c-9532-7ff0cc654023 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:50.736875 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693110f-7303-42d6-b758-e1907ad88570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:50.738922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693110f-7303-42d6-b758-e1907ad88570 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.739065 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693110f-7303-42d6-b758-e1907ad88570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.739468 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693110f-7303-42d6-b758-e1907ad88570 admin admin] PATH_INFO: `/v3/projects/2b9a8a84b4ad4bf3a1fe1abc9d90c1d1/users/ccd9d4fa48014b6cab055ce58a6be7e3/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.763326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693110f-7303-42d6-b758-e1907ad88570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9a8a84b4ad4bf3a1fe1abc9d90c1d1, user_id=ccd9d4fa48014b6cab055ce58a6be7e3, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:50.767826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693110f-7303-42d6-b758-e1907ad88570 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:50.890373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1345/2653] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:50 2022] PUT /identity/v3/projects/2b9a8a84b4ad4bf3a1fe1abc9d90c1d1/users/ccd9d4fa48014b6cab055ce58a6be7e3/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:50.902056 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae8f8-bb16-437b-a1f6-0b4f6c92d7d4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.902416 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae8f8-bb16-437b-a1f6-0b4f6c92d7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.902677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae8f8-bb16-437b-a1f6-0b4f6c92d7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.929699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-785ae8f8-bb16-437b-a1f6-0b4f6c92d7d4 None None] MFA Rules not processed for user `ccd9d4fa48014b6cab055ce58a6be7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:50.930893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-785ae8f8-bb16-437b-a1f6-0b4f6c92d7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:50.992695 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1309/2654] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:50.997717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693110f-7303-42d6-b758-e1907ad88570 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:51.047160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:51.061182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693110f-7303-42d6-b758-e1907ad88570 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:51.065810 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300e91d-5b06-4af8-ac78-6895a2283c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:51.066411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300e91d-5b06-4af8-ac78-6895a2283c87 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:51.066685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300e91d-5b06-4af8-ac78-6895a2283c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:51.066952 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300e91d-5b06-4af8-ac78-6895a2283c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:51.067574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300e91d-5b06-4af8-ac78-6895a2283c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:51.069432 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300e91d-5b06-4af8-ac78-6895a2283c87 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:51.169000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1346/2655] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:50 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:51.172994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ae8f8-bb16-437b-a1f6-0b4f6c92d7d4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:51.184244 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ae8f8-bb16-437b-a1f6-0b4f6c92d7d4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:51.240769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68428a26-575a-4985-b928-50d13a63c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:51.241727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68428a26-575a-4985-b928-50d13a63c5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:51.242794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68428a26-575a-4985-b928-50d13a63c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:51.243087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68428a26-575a-4985-b928-50d13a63c5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:51.244041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68428a26-575a-4985-b928-50d13a63c5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:51.247018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68428a26-575a-4985-b928-50d13a63c5c2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:51.331151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1310/2656] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:51 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:51.334921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300e91d-5b06-4af8-ac78-6895a2283c87 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:51.345922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300e91d-5b06-4af8-ac78-6895a2283c87 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:51.350552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462d5fb-f2a5-43a4-b26f-b5024853e4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:51.351144 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462d5fb-f2a5-43a4-b26f-b5024853e4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:51.351413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462d5fb-f2a5-43a4-b26f-b5024853e4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:51.351676 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462d5fb-f2a5-43a4-b26f-b5024853e4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:51.352304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462d5fb-f2a5-43a4-b26f-b5024853e4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:51.354827 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462d5fb-f2a5-43a4-b26f-b5024853e4c5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:51.365034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1347/2657] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:51.369701 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68428a26-575a-4985-b928-50d13a63c5c2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:51.379629 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68428a26-575a-4985-b928-50d13a63c5c2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:51.384222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaaf67-afd4-4e40-b687-4d4a5e3d3bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:51.384856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaaf67-afd4-4e40-b687-4d4a5e3d3bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:51.385132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaaf67-afd4-4e40-b687-4d4a5e3d3bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:51.385402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaaf67-afd4-4e40-b687-4d4a5e3d3bbe admin admin] PATH_INFO: `/v3/projects/1e5d0aec1db7473cb93566e4ef19bc4f/users/5d47ea38b34543cabf6ba9878500227f/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:51.400915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaaf67-afd4-4e40-b687-4d4a5e3d3bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5d0aec1db7473cb93566e4ef19bc4f, user_id=5d47ea38b34543cabf6ba9878500227f, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:51.403719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaaf67-afd4-4e40-b687-4d4a5e3d3bbe admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:51.418573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:51.484429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1311/2658] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:51 2022] PUT /identity/v3/projects/1e5d0aec1db7473cb93566e4ef19bc4f/users/5d47ea38b34543cabf6ba9878500227f/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:51.488409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462d5fb-f2a5-43a4-b26f-b5024853e4c5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:51.498534 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462d5fb-f2a5-43a4-b26f-b5024853e4c5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:51.555155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715221ae-d752-46cc-87da-38c001312009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:51.555861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715221ae-d752-46cc-87da-38c001312009 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:51.556854 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715221ae-d752-46cc-87da-38c001312009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:51.557176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715221ae-d752-46cc-87da-38c001312009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:51.557841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715221ae-d752-46cc-87da-38c001312009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:51.559423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715221ae-d752-46cc-87da-38c001312009 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:51.568937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1348/2659] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:51.573921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaaf67-afd4-4e40-b687-4d4a5e3d3bbe admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:51.584151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaaf67-afd4-4e40-b687-4d4a5e3d3bbe admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:51.589570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6771be-612a-4140-b747-043dffa2c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:51.590218 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6771be-612a-4140-b747-043dffa2c685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:51.590491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6771be-612a-4140-b747-043dffa2c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:51.590812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6771be-612a-4140-b747-043dffa2c685 admin admin] PATH_INFO: `/v3/projects/1e5d0aec1db7473cb93566e4ef19bc4f/users/5d47ea38b34543cabf6ba9878500227f/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:51.592722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6771be-612a-4140-b747-043dffa2c685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5d0aec1db7473cb93566e4ef19bc4f, user_id=5d47ea38b34543cabf6ba9878500227f, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:51.596076 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6771be-612a-4140-b747-043dffa2c685 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:51.608817 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1312/2660] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:51 2022] PUT /identity/v3/projects/1e5d0aec1db7473cb93566e4ef19bc4f/users/5d47ea38b34543cabf6ba9878500227f/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:51.618151 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d3dc5-1254-44ec-a42c-44c9c852f626 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:51.618430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d3dc5-1254-44ec-a42c-44c9c852f626 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:51.618829 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d3dc5-1254-44ec-a42c-44c9c852f626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:51.648475 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b31d3dc5-1254-44ec-a42c-44c9c852f626 None None] MFA Rules not processed for user `5d47ea38b34543cabf6ba9878500227f`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:51.649749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b31d3dc5-1254-44ec-a42c-44c9c852f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:51.723407 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1349/2661] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:51.734936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6771be-612a-4140-b747-043dffa2c685 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:51.736789 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6d6771be-612a-4140-b747-043dffa2c685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:51.774600 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d3dc5-1254-44ec-a42c-44c9c852f626 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:51.776860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b31d3dc5-1254-44ec-a42c-44c9c852f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:51.798434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6771be-612a-4140-b747-043dffa2c685 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:51.802224 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3ce9b-cebd-4ef5-b605-c786e4b2ac0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:51.802830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3ce9b-cebd-4ef5-b605-c786e4b2ac0b service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:51.803112 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3ce9b-cebd-4ef5-b605-c786e4b2ac0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:51.803384 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3ce9b-cebd-4ef5-b605-c786e4b2ac0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:51.812812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3ce9b-cebd-4ef5-b605-c786e4b2ac0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:51.814294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3ce9b-cebd-4ef5-b605-c786e4b2ac0b service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:51.826911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:51.835626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1313/2662] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:51.847091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d3dc5-1254-44ec-a42c-44c9c852f626 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:51.851929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:51.852778 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:51.853127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:51.853440 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] PATH_INFO: `/v3/users/0756aeb81588498794f8a94fdaa3cb58` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:51.854666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0756aeb81588498794f8a94fdaa3cb58)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:51.856709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:52.108861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0756aeb81588498794f8a94fdaa3cb58'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.109490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0756aeb81588498794f8a94fdaa3cb58'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.110219 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0756aeb81588498794f8a94fdaa3cb58'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.112399 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3ce9b-cebd-4ef5-b605-c786e4b2ac0b service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:52.121723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3ce9b-cebd-4ef5-b605-c786e4b2ac0b service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:52.125232 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f019ea-ee91-4f16-adda-344fa998409c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:52.125843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f019ea-ee91-4f16-adda-344fa998409c service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:52.126114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f019ea-ee91-4f16-adda-344fa998409c service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:52.126376 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f019ea-ee91-4f16-adda-344fa998409c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:52.128080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-09f019ea-ee91-4f16-adda-344fa998409c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:52.186902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0756aeb81588498794f8a94fdaa3cb58'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.194707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f019ea-ee91-4f16-adda-344fa998409c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:52.196110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f019ea-ee91-4f16-adda-344fa998409c service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:52.203048 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0756aeb81588498794f8a94fdaa3cb58'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:52.206624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1314/2663] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:52.226969 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1350/2664] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:51 2022] DELETE /identity/v3/users/0756aeb81588498794f8a94fdaa3cb58 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:52.231460 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776ce5b-6ee3-4142-a168-e4038b867840 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:52.231749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776ce5b-6ee3-4142-a168-e4038b867840 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:52.232019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776ce5b-6ee3-4142-a168-e4038b867840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:52.253145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a776ce5b-6ee3-4142-a168-e4038b867840 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:52.254431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a776ce5b-6ee3-4142-a168-e4038b867840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:52.278753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:52.326718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1315/2665] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:52.341230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:52.341230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:52.397548 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c2801-a1d3-41e5-9bad-d5ea36cc52d9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:52.401826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26eb54-0f85-4ea7-b0ae-6c7970f67b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:52.401826 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26eb54-0f85-4ea7-b0ae-6c7970f67b33 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:52.402055 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26eb54-0f85-4ea7-b0ae-6c7970f67b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:52.402335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26eb54-0f85-4ea7-b0ae-6c7970f67b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:52.411599 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26eb54-0f85-4ea7-b0ae-6c7970f67b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:52.413001 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26eb54-0f85-4ea7-b0ae-6c7970f67b33 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:52.423071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1351/2666] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:52.932375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776ce5b-6ee3-4142-a168-e4038b867840 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:52.934091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a776ce5b-6ee3-4142-a168-e4038b867840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:52.946834 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776ce5b-6ee3-4142-a168-e4038b867840 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:52.951669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:52.952302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:52.952580 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:52.952849 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] PATH_INFO: `/v3/projects/d43de09c947b4e2d8d7e0edaf9b56b5d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:52.954245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43de09c947b4e2d8d7e0edaf9b56b5d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:52.956036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:53.102837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43de09c947b4e2d8d7e0edaf9b56b5d', 'request_id': 'req-69024936-5648-4828-80b4-dbf31620c144'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.109339 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43de09c947b4e2d8d7e0edaf9b56b5d', 'request_id': 'req-69024936-5648-4828-80b4-dbf31620c144'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.116727 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43de09c947b4e2d8d7e0edaf9b56b5d', 'request_id': 'req-69024936-5648-4828-80b4-dbf31620c144'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.208986 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] The token cache is being invalidate because project d43de09c947b4e2d8d7e0edaf9b56b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:53.209628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.209935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.211396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1316/2667] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:52 2022] DELETE /identity/v3/projects/d43de09c947b4e2d8d7e0edaf9b56b5d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:53.222374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26eb54-0f85-4ea7-b0ae-6c7970f67b33 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:53.232335 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26eb54-0f85-4ea7-b0ae-6c7970f67b33 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:53.295232 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:53.295784 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:53.296058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:53.296325 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] PATH_INFO: `/v3/users/6df7f9150c54499881022b15343caaa3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:53.297436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df7f9150c54499881022b15343caaa3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:53.299490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:53.305246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:53.541604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df7f9150c54499881022b15343caaa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.542346 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df7f9150c54499881022b15343caaa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.542955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df7f9150c54499881022b15343caaa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.667373 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df7f9150c54499881022b15343caaa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.680180 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b700837a-8775-4049-9bab-c941b94b7eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df7f9150c54499881022b15343caaa3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:53.693089 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1352/2668] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:53 2022] DELETE /identity/v3/users/6df7f9150c54499881022b15343caaa3 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:54.178220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:54.179645 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:54.195880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69024936-5648-4828-80b4-dbf31620c144 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:54.260509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:54.261262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:54.261576 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:54.261854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] PATH_INFO: `/v3/projects/d3a215a13a7548d195f30917912dcbfc` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:54.263008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a215a13a7548d195f30917912dcbfc)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:54.264964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:54.399162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a215a13a7548d195f30917912dcbfc', 'request_id': 'req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:54.403146 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:54.405329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a215a13a7548d195f30917912dcbfc', 'request_id': 'req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:54.411502 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a215a13a7548d195f30917912dcbfc', 'request_id': 'req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:54.552774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] The token cache is being invalidate because project d3a215a13a7548d195f30917912dcbfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:54.553130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:54.553891 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9cc0bc26-ea22-48bc-b00f-4b6ec423cd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:54.555630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1317/2669] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:54 2022] DELETE /identity/v3/projects/d3a215a13a7548d195f30917912dcbfc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:54.561160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f2270-a9f3-4af7-bb1d-032a9a52235e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:54.561678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f2270-a9f3-4af7-bb1d-032a9a52235e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:54.561678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f2270-a9f3-4af7-bb1d-032a9a52235e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:54.581960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-3d9f2270-a9f3-4af7-bb1d-032a9a52235e None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:54.583170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3d9f2270-a9f3-4af7-bb1d-032a9a52235e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:54.665208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1353/2670] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:54.669758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488223-9b26-43be-b8d8-d0ce9a5c7556 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:54.670045 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488223-9b26-43be-b8d8-d0ce9a5c7556 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:54.670390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488223-9b26-43be-b8d8-d0ce9a5c7556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:54.691504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-30488223-9b26-43be-b8d8-d0ce9a5c7556 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:54.692738 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-30488223-9b26-43be-b8d8-d0ce9a5c7556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:54.701512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1318/2671] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:54.705495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f2270-a9f3-4af7-bb1d-032a9a52235e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:54.715372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f2270-a9f3-4af7-bb1d-032a9a52235e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:54.720007 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01daf04-2e2c-43f9-b2a9-314d796cd1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:54.720602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01daf04-2e2c-43f9-b2a9-314d796cd1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:54.720871 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01daf04-2e2c-43f9-b2a9-314d796cd1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:54.721137 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01daf04-2e2c-43f9-b2a9-314d796cd1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:54.721807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01daf04-2e2c-43f9-b2a9-314d796cd1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:54.722103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01daf04-2e2c-43f9-b2a9-314d796cd1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:54.723745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01daf04-2e2c-43f9-b2a9-314d796cd1f0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:54.739666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1354/2672] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:54.740786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30488223-9b26-43be-b8d8-d0ce9a5c7556 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:54.752255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30488223-9b26-43be-b8d8-d0ce9a5c7556 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:54.756933 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baa1d9-d196-411f-b457-12e0a98426b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:54.757548 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa1d9-d196-411f-b457-12e0a98426b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:54.757825 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa1d9-d196-411f-b457-12e0a98426b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:54.758119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baa1d9-d196-411f-b457-12e0a98426b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:54.758745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baa1d9-d196-411f-b457-12e0a98426b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:54.760964 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baa1d9-d196-411f-b457-12e0a98426b4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:54.845918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1319/2673] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:54 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:54.847058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01daf04-2e2c-43f9-b2a9-314d796cd1f0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:54.857994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01daf04-2e2c-43f9-b2a9-314d796cd1f0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:54.914100 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdfb6-64ba-4003-a0a8-27a171a37140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:54.914706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdfb6-64ba-4003-a0a8-27a171a37140 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:54.914985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdfb6-64ba-4003-a0a8-27a171a37140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:54.915784 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdfb6-64ba-4003-a0a8-27a171a37140 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:54.916530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bdfb6-64ba-4003-a0a8-27a171a37140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:54.918464 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bdfb6-64ba-4003-a0a8-27a171a37140 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:54.995546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1355/2674] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:54 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:54.999812 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baa1d9-d196-411f-b457-12e0a98426b4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.011794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baa1d9-d196-411f-b457-12e0a98426b4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.018739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f46128-6314-4752-8e8b-ee6a78df2c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.019400 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f46128-6314-4752-8e8b-ee6a78df2c7b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.019674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f46128-6314-4752-8e8b-ee6a78df2c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.020019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f46128-6314-4752-8e8b-ee6a78df2c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.021043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f46128-6314-4752-8e8b-ee6a78df2c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.023087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f46128-6314-4752-8e8b-ee6a78df2c7b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.034067 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1320/2675] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:55.038033 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdfb6-64ba-4003-a0a8-27a171a37140 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.050347 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdfb6-64ba-4003-a0a8-27a171a37140 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.055197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f654e-bbff-4151-a955-7a9e2befce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.055887 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f654e-bbff-4151-a955-7a9e2befce0b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.056238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f654e-bbff-4151-a955-7a9e2befce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.056575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f654e-bbff-4151-a955-7a9e2befce0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.057217 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f654e-bbff-4151-a955-7a9e2befce0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.059018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f654e-bbff-4151-a955-7a9e2befce0b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.069757 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1356/2676] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:55.071927 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:55.074385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f46128-6314-4752-8e8b-ee6a78df2c7b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.084541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f46128-6314-4752-8e8b-ee6a78df2c7b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.090758 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df784d-5f57-4669-953b-cb95821c1466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.091398 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df784d-5f57-4669-953b-cb95821c1466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.093239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df784d-5f57-4669-953b-cb95821c1466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.093239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df784d-5f57-4669-953b-cb95821c1466 admin admin] PATH_INFO: `/v3/projects/f9c52083839046ebb0623fdf57492a09/users/ba73039e41a04a9aa3d9d713f5d72840/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.106970 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df784d-5f57-4669-953b-cb95821c1466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c52083839046ebb0623fdf57492a09, user_id=ba73039e41a04a9aa3d9d713f5d72840, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.109787 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df784d-5f57-4669-953b-cb95821c1466 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.167523 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f654e-bbff-4151-a955-7a9e2befce0b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.169301 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fa0f654e-bbff-4151-a955-7a9e2befce0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:55.175573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1321/2677] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:55 2022] PUT /identity/v3/projects/f9c52083839046ebb0623fdf57492a09/users/ba73039e41a04a9aa3d9d713f5d72840/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:55.181863 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f654e-bbff-4151-a955-7a9e2befce0b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.188003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc9ef7-94a0-47dc-89a5-c263db799740 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.188335 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc9ef7-94a0-47dc-89a5-c263db799740 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.188610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc9ef7-94a0-47dc-89a5-c263db799740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.218558 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e4dc9ef7-94a0-47dc-89a5-c263db799740 None None] MFA Rules not processed for user `ba73039e41a04a9aa3d9d713f5d72840`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:55.222403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e4dc9ef7-94a0-47dc-89a5-c263db799740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:55.243756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.244413 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.244685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.244953 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] PATH_INFO: `/v3/users/f5582000d8634b318dae0384c822beac` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.246115 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5582000d8634b318dae0384c822beac)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.251079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.285226 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1322/2678] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:55.289706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc9ef7-94a0-47dc-89a5-c263db799740 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.301295 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc9ef7-94a0-47dc-89a5-c263db799740 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.305921 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d3341-8f7e-42c2-96cb-30e24abb5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.308431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d3341-8f7e-42c2-96cb-30e24abb5689 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.308431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d3341-8f7e-42c2-96cb-30e24abb5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.308431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d3341-8f7e-42c2-96cb-30e24abb5689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.308431 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d3341-8f7e-42c2-96cb-30e24abb5689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.309565 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d3341-8f7e-42c2-96cb-30e24abb5689 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.431447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1323/2679] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:55 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:55.432496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d3341-8f7e-42c2-96cb-30e24abb5689 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.467495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5582000d8634b318dae0384c822beac'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:55.468163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5582000d8634b318dae0384c822beac'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:55.468773 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5582000d8634b318dae0384c822beac'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:55.484916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:55.499316 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d3341-8f7e-42c2-96cb-30e24abb5689 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.504051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f98f-fec2-4c64-814f-c2154dbffac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.504734 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f98f-fec2-4c64-814f-c2154dbffac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.505013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f98f-fec2-4c64-814f-c2154dbffac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.505341 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f98f-fec2-4c64-814f-c2154dbffac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.506000 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900f98f-fec2-4c64-814f-c2154dbffac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.507929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900f98f-fec2-4c64-814f-c2154dbffac7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.575094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5582000d8634b318dae0384c822beac'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:55.588079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-80c967a0-da67-4252-9092-10cd8b855d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5582000d8634b318dae0384c822beac'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:55.600985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1357/2680] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:55 2022] DELETE /identity/v3/users/f5582000d8634b318dae0384c822beac => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:55.605766 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1f23-9cae-464b-833d-cbe439924b76 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.606017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1f23-9cae-464b-833d-cbe439924b76 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.606302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1f23-9cae-464b-833d-cbe439924b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.625634 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5a3e1f23-9cae-464b-833d-cbe439924b76 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:55.626756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5a3e1f23-9cae-464b-833d-cbe439924b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:55.632748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1324/2681] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:55 2022] POST /identity/v3/users => generated 303 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:55.637494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f98f-fec2-4c64-814f-c2154dbffac7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.639366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d900f98f-fec2-4c64-814f-c2154dbffac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:55.652204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f98f-fec2-4c64-814f-c2154dbffac7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.691831 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1358/2682] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:55.712066 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1f23-9cae-464b-833d-cbe439924b76 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.713679 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5a3e1f23-9cae-464b-833d-cbe439924b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:55.719199 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b87d24-c477-4517-b097-d5bad5bea2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.720541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b87d24-c477-4517-b097-d5bad5bea2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.722956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b87d24-c477-4517-b097-d5bad5bea2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.722956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b87d24-c477-4517-b097-d5bad5bea2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.722956 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b87d24-c477-4517-b097-d5bad5bea2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.723547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b87d24-c477-4517-b097-d5bad5bea2ca admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.731504 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:55.737510 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1325/2683] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:55.739004 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b87d24-c477-4517-b097-d5bad5bea2ca admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.750382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b87d24-c477-4517-b097-d5bad5bea2ca admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.766625 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578dff4-84f1-40b5-94f9-71b60e5dbde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.767287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578dff4-84f1-40b5-94f9-71b60e5dbde4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.767561 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578dff4-84f1-40b5-94f9-71b60e5dbde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.768219 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578dff4-84f1-40b5-94f9-71b60e5dbde4 admin admin] PATH_INFO: `/v3/projects/9cc6ad8a10ac4e0995f656d73ffe719a/users/ae5e24fb660f432eb4cb37552c72789a/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.782704 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1f23-9cae-464b-833d-cbe439924b76 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.784613 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578dff4-84f1-40b5-94f9-71b60e5dbde4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc6ad8a10ac4e0995f656d73ffe719a, user_id=ae5e24fb660f432eb4cb37552c72789a, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.786860 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cee513-f874-49d1-a16e-62cab252f259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.787332 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578dff4-84f1-40b5-94f9-71b60e5dbde4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.787471 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cee513-f874-49d1-a16e-62cab252f259 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.787751 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cee513-f874-49d1-a16e-62cab252f259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.788143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cee513-f874-49d1-a16e-62cab252f259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.799343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cee513-f874-49d1-a16e-62cab252f259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.801135 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cee513-f874-49d1-a16e-62cab252f259 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.811499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1359/2684] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:55.855569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1326/2685] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:55 2022] PUT /identity/v3/projects/9cc6ad8a10ac4e0995f656d73ffe719a/users/ae5e24fb660f432eb4cb37552c72789a/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:55.859557 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cee513-f874-49d1-a16e-62cab252f259 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.870905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cee513-f874-49d1-a16e-62cab252f259 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.927372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93f901-8c4e-4478-a06c-e7f9508265eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.927998 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93f901-8c4e-4478-a06c-e7f9508265eb admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.928272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93f901-8c4e-4478-a06c-e7f9508265eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.928536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93f901-8c4e-4478-a06c-e7f9508265eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.929166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93f901-8c4e-4478-a06c-e7f9508265eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.930776 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93f901-8c4e-4478-a06c-e7f9508265eb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.941422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1360/2686] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:55.945816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578dff4-84f1-40b5-94f9-71b60e5dbde4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:55.956779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578dff4-84f1-40b5-94f9-71b60e5dbde4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:55.961367 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0e3d-7f79-4a98-a8af-5acf43af7ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:55.962070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0e3d-7f79-4a98-a8af-5acf43af7ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.962340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0e3d-7f79-4a98-a8af-5acf43af7ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.962604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0e3d-7f79-4a98-a8af-5acf43af7ac8 admin admin] PATH_INFO: `/v3/projects/9cc6ad8a10ac4e0995f656d73ffe719a/users/ae5e24fb660f432eb4cb37552c72789a/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:55.964458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0e3d-7f79-4a98-a8af-5acf43af7ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc6ad8a10ac4e0995f656d73ffe719a, user_id=ae5e24fb660f432eb4cb37552c72789a, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:55.967089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0e3d-7f79-4a98-a8af-5acf43af7ac8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:55.977003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1327/2687] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:55 2022] PUT /identity/v3/projects/9cc6ad8a10ac4e0995f656d73ffe719a/users/ae5e24fb660f432eb4cb37552c72789a/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:55.988444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd4c24-35cf-4373-b36c-63af202515c2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:55.990622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd4c24-35cf-4373-b36c-63af202515c2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:55.990622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd4c24-35cf-4373-b36c-63af202515c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:56.017719 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e5cd4c24-35cf-4373-b36c-63af202515c2 None None] MFA Rules not processed for user `ae5e24fb660f432eb4cb37552c72789a`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:56.018921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e5cd4c24-35cf-4373-b36c-63af202515c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:56.098642 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1361/2688] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:56.110512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0e3d-7f79-4a98-a8af-5acf43af7ac8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:56.112310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d72f0e3d-7f79-4a98-a8af-5acf43af7ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:56.178478 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0e3d-7f79-4a98-a8af-5acf43af7ac8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:56.184592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4d3a-5258-46f2-a8b6-979fc4137e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:56.189071 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4d3a-5258-46f2-a8b6-979fc4137e5d service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:56.189071 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4d3a-5258-46f2-a8b6-979fc4137e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:56.189071 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af4d3a-5258-46f2-a8b6-979fc4137e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:56.200973 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af4d3a-5258-46f2-a8b6-979fc4137e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:56.202471 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af4d3a-5258-46f2-a8b6-979fc4137e5d service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:56.213288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1328/2689] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:56.265294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd4c24-35cf-4373-b36c-63af202515c2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:56.275621 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd4c24-35cf-4373-b36c-63af202515c2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:56.279230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905b48d-0833-4bad-b087-c42cc72ae6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:56.279822 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905b48d-0833-4bad-b087-c42cc72ae6ee service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:56.280097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905b48d-0833-4bad-b087-c42cc72ae6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:56.280366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905b48d-0833-4bad-b087-c42cc72ae6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:56.282120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f905b48d-0833-4bad-b087-c42cc72ae6ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:56.295012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4d3a-5258-46f2-a8b6-979fc4137e5d service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:56.296422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-05af4d3a-5258-46f2-a8b6-979fc4137e5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:56.348907 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:56.360440 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:56.377640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905b48d-0833-4bad-b087-c42cc72ae6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:56.379079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905b48d-0833-4bad-b087-c42cc72ae6ee service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:56.388134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1362/2690] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:56.396839 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af4d3a-5258-46f2-a8b6-979fc4137e5d service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:56.396839 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:56.396839 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:56.396839 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:56.397692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] PATH_INFO: `/v3/projects/2ae23e2c35b5466cb80f247c53683ba0` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:56.397692 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae23e2c35b5466cb80f247c53683ba0)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:56.398496 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:56.490836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae23e2c35b5466cb80f247c53683ba0', 'request_id': 'req-07a235c8-8402-4ea3-98dc-e696770b9549'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:56.497791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae23e2c35b5466cb80f247c53683ba0', 'request_id': 'req-07a235c8-8402-4ea3-98dc-e696770b9549'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:56.504069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae23e2c35b5466cb80f247c53683ba0', 'request_id': 'req-07a235c8-8402-4ea3-98dc-e696770b9549'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:56.612840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] The token cache is being invalidate because project 2ae23e2c35b5466cb80f247c53683ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:56.613126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:56.613777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:56.615289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1329/2691] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:56 2022] DELETE /identity/v3/projects/2ae23e2c35b5466cb80f247c53683ba0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:56.620129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905b48d-0833-4bad-b087-c42cc72ae6ee service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:56.631319 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905b48d-0833-4bad-b087-c42cc72ae6ee service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:56.693955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:56.694579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:56.694850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:56.695117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] PATH_INFO: `/v3/users/f9e23454efae42ee8a7d6222c0e5ce03` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:56.696252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e23454efae42ee8a7d6222c0e5ce03)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:56.698819 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:56.907311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e23454efae42ee8a7d6222c0e5ce03'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:56.908000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e23454efae42ee8a7d6222c0e5ce03'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:56.908625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e23454efae42ee8a7d6222c0e5ce03'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:57.000839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e23454efae42ee8a7d6222c0e5ce03'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:57.014798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-830610b4-734c-4e1a-a9a2-eeac76692ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e23454efae42ee8a7d6222c0e5ce03'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:57.027124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1363/2692] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:56 2022] DELETE /identity/v3/users/f9e23454efae42ee8a7d6222c0e5ce03 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:57.468402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:57.470500 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:57.484999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a235c8-8402-4ea3-98dc-e696770b9549 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:57.542777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:57.546620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:57.546620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:57.546620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] PATH_INFO: `/v3/projects/31d5b38c142a4d65a46a3effd835005d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:57.546620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d5b38c142a4d65a46a3effd835005d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:57.547034 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:57.665001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d5b38c142a4d65a46a3effd835005d', 'request_id': 'req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:57.670713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d5b38c142a4d65a46a3effd835005d', 'request_id': 'req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:57.676800 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d5b38c142a4d65a46a3effd835005d', 'request_id': 'req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:57.750718 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:57.755364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] The token cache is being invalidate because project 31d5b38c142a4d65a46a3effd835005d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:57.755650 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:57.756260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2cfff5b4-ab20-4b81-bf47-56f24a0fea56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:57.757765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1330/2693] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:57 2022] DELETE /identity/v3/projects/31d5b38c142a4d65a46a3effd835005d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:57.765565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d3c03-9341-47fa-9f23-daa76a7851b7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:57.765565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d3c03-9341-47fa-9f23-daa76a7851b7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:57.765565 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d3c03-9341-47fa-9f23-daa76a7851b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:57.784812 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-550d3c03-9341-47fa-9f23-daa76a7851b7 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:57.786104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-550d3c03-9341-47fa-9f23-daa76a7851b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:57.839893 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:57.852042 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1364/2694] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:57.860225 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c0830-143d-4299-867f-4bde1806cdbc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:57.860568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c0830-143d-4299-867f-4bde1806cdbc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:57.860894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c0830-143d-4299-867f-4bde1806cdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:57.881329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6f9c0830-143d-4299-867f-4bde1806cdbc None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:57.882563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6f9c0830-143d-4299-867f-4bde1806cdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:57.891346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1331/2695] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:57.896913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d3c03-9341-47fa-9f23-daa76a7851b7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:57.906748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d3c03-9341-47fa-9f23-daa76a7851b7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:57.911474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce31777-119b-44f4-a8d5-4babe5679ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:57.912069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce31777-119b-44f4-a8d5-4babe5679ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:57.912343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce31777-119b-44f4-a8d5-4babe5679ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:57.912605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce31777-119b-44f4-a8d5-4babe5679ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:57.913244 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce31777-119b-44f4-a8d5-4babe5679ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:57.913696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce31777-119b-44f4-a8d5-4babe5679ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:57.915974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce31777-119b-44f4-a8d5-4babe5679ca0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:57.928633 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1365/2696] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:57.941968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c0830-143d-4299-867f-4bde1806cdbc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:57.951614 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c0830-143d-4299-867f-4bde1806cdbc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:57.956157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6217-dad6-42e4-934c-ecbbe9a0bc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:57.956777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6217-dad6-42e4-934c-ecbbe9a0bc52 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:57.957046 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6217-dad6-42e4-934c-ecbbe9a0bc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:57.957309 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6217-dad6-42e4-934c-ecbbe9a0bc52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:57.957969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b6217-dad6-42e4-934c-ecbbe9a0bc52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:57.959885 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b6217-dad6-42e4-934c-ecbbe9a0bc52 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:58.039351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1332/2697] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:57 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:58.044113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce31777-119b-44f4-a8d5-4babe5679ca0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:58.055537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce31777-119b-44f4-a8d5-4babe5679ca0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:58.115106 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6637e0c-6c98-47e7-86ff-92ece5b88bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:58.115720 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6637e0c-6c98-47e7-86ff-92ece5b88bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:58.116261 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6637e0c-6c98-47e7-86ff-92ece5b88bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:58.116537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6637e0c-6c98-47e7-86ff-92ece5b88bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:58.117188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6637e0c-6c98-47e7-86ff-92ece5b88bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:58.119275 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6637e0c-6c98-47e7-86ff-92ece5b88bd7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:58.225991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1366/2698] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:58 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:58.230663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6217-dad6-42e4-934c-ecbbe9a0bc52 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:58.246128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6217-dad6-42e4-934c-ecbbe9a0bc52 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:58.256191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfe63-edd4-438c-a9bc-4f86a9c03d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:58.256926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfe63-edd4-438c-a9bc-4f86a9c03d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:58.257336 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfe63-edd4-438c-a9bc-4f86a9c03d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:58.257877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfe63-edd4-438c-a9bc-4f86a9c03d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:58.258647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfe63-edd4-438c-a9bc-4f86a9c03d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:58.261060 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfe63-edd4-438c-a9bc-4f86a9c03d5d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:58.278205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1333/2699] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:58.279682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6637e0c-6c98-47e7-86ff-92ece5b88bd7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:58.294929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6637e0c-6c98-47e7-86ff-92ece5b88bd7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:58.299988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6c44-0d3f-4507-afaa-37c30e3e98fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:58.300608 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6c44-0d3f-4507-afaa-37c30e3e98fd admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:58.300954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6c44-0d3f-4507-afaa-37c30e3e98fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:58.301154 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6c44-0d3f-4507-afaa-37c30e3e98fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:58.301884 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6c44-0d3f-4507-afaa-37c30e3e98fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:58.303561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6c44-0d3f-4507-afaa-37c30e3e98fd admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:58.325529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1367/2700] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:58.327151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfe63-edd4-438c-a9bc-4f86a9c03d5d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:58.339491 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfe63-edd4-438c-a9bc-4f86a9c03d5d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:58.344311 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f7c58-2785-4065-963d-52adc3f9874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:58.345110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f7c58-2785-4065-963d-52adc3f9874d admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:58.345439 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f7c58-2785-4065-963d-52adc3f9874d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:58.345813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f7c58-2785-4065-963d-52adc3f9874d admin admin] PATH_INFO: `/v3/projects/2477626b67b54c11be53ef34c3b60557/users/31a3d9f7a45049c694bc48c56d146cf7/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:58.369290 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f7c58-2785-4065-963d-52adc3f9874d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2477626b67b54c11be53ef34c3b60557, user_id=31a3d9f7a45049c694bc48c56d146cf7, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:58.373498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f7c58-2785-4065-963d-52adc3f9874d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:58.472742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1334/2701] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:58 2022] PUT /identity/v3/projects/2477626b67b54c11be53ef34c3b60557/users/31a3d9f7a45049c694bc48c56d146cf7/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:58.483119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d18e6-5782-484c-9281-6a5d35bce911 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:58.483405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d18e6-5782-484c-9281-6a5d35bce911 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:58.483682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d18e6-5782-484c-9281-6a5d35bce911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:58.522068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d87d18e6-5782-484c-9281-6a5d35bce911 None None] MFA Rules not processed for user `31a3d9f7a45049c694bc48c56d146cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:58.524374 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d87d18e6-5782-484c-9281-6a5d35bce911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:58.603134 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1368/2702] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:58.608711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f7c58-2785-4065-963d-52adc3f9874d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:58.707878 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f7c58-2785-4065-963d-52adc3f9874d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:58.714097 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1e86b-7738-45e0-87a9-6f252368a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:58.714705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1e86b-7738-45e0-87a9-6f252368a2ad admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:58.714996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1e86b-7738-45e0-87a9-6f252368a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:58.715255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1e86b-7738-45e0-87a9-6f252368a2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:58.715886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1e86b-7738-45e0-87a9-6f252368a2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:58.717962 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1e86b-7738-45e0-87a9-6f252368a2ad admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:58.854110 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1335/2703] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:58 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:58.858295 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d18e6-5782-484c-9281-6a5d35bce911 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:58.869889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d18e6-5782-484c-9281-6a5d35bce911 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:58.915895 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:58.927842 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb01b6d-c6c0-4612-817e-bb2ec756b2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:58.928456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb01b6d-c6c0-4612-817e-bb2ec756b2cd admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:58.928733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb01b6d-c6c0-4612-817e-bb2ec756b2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:58.929805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb01b6d-c6c0-4612-817e-bb2ec756b2cd admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:58.930449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb01b6d-c6c0-4612-817e-bb2ec756b2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:58.933012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb01b6d-c6c0-4612-817e-bb2ec756b2cd admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:59.047536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1369/2704] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:58 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:59.050774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1e86b-7738-45e0-87a9-6f252368a2ad admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:59.065275 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1e86b-7738-45e0-87a9-6f252368a2ad admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:59.070926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c251ff-1a6d-4878-a009-b3a7e24af374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:59.071610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c251ff-1a6d-4878-a009-b3a7e24af374 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:59.071824 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c251ff-1a6d-4878-a009-b3a7e24af374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:59.072261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c251ff-1a6d-4878-a009-b3a7e24af374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:59.072935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c251ff-1a6d-4878-a009-b3a7e24af374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:59.074786 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c251ff-1a6d-4878-a009-b3a7e24af374 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:59.087971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1336/2705] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:59.092584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb01b6d-c6c0-4612-817e-bb2ec756b2cd admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:59.104296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb01b6d-c6c0-4612-817e-bb2ec756b2cd admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:59.116062 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9f14-aefc-406b-ab2a-690daaf81ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:59.116935 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9f14-aefc-406b-ab2a-690daaf81ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:59.117308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9f14-aefc-406b-ab2a-690daaf81ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:59.117680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9f14-aefc-406b-ab2a-690daaf81ce2 admin admin] PATH_INFO: `/v3/projects/2b24275f80e6401d8bb82452ef943cce/users/4bea52e6b5104781a3cea5d9a7cff484/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:59.136173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac9f14-aefc-406b-ab2a-690daaf81ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b24275f80e6401d8bb82452ef943cce, user_id=4bea52e6b5104781a3cea5d9a7cff484, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:59.139225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac9f14-aefc-406b-ab2a-690daaf81ce2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:59.233150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1370/2706] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:59 2022] PUT /identity/v3/projects/2b24275f80e6401d8bb82452ef943cce/users/4bea52e6b5104781a3cea5d9a7cff484/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:59.237434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c251ff-1a6d-4878-a009-b3a7e24af374 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:59.248526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c251ff-1a6d-4878-a009-b3a7e24af374 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:59.305434 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6b9e-ed2e-47d3-8312-b3470da9e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:59.306593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6b9e-ed2e-47d3-8312-b3470da9e34d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:59.306866 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6b9e-ed2e-47d3-8312-b3470da9e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:59.307127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6b9e-ed2e-47d3-8312-b3470da9e34d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:59.307756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6b9e-ed2e-47d3-8312-b3470da9e34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:59.309369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6b9e-ed2e-47d3-8312-b3470da9e34d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:59.320473 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1337/2707] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:59.325068 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9f14-aefc-406b-ab2a-690daaf81ce2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:59.336647 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9f14-aefc-406b-ab2a-690daaf81ce2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:59.340910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bf9ab-c9dc-4bd2-8326-005bf1362c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:59.346729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bf9ab-c9dc-4bd2-8326-005bf1362c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:59.346729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bf9ab-c9dc-4bd2-8326-005bf1362c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:59.346729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bf9ab-c9dc-4bd2-8326-005bf1362c7b admin admin] PATH_INFO: `/v3/projects/2b24275f80e6401d8bb82452ef943cce/users/4bea52e6b5104781a3cea5d9a7cff484/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:59.346729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bf9ab-c9dc-4bd2-8326-005bf1362c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b24275f80e6401d8bb82452ef943cce, user_id=4bea52e6b5104781a3cea5d9a7cff484, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:59.347139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bf9ab-c9dc-4bd2-8326-005bf1362c7b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:59.358902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1371/2708] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:59 2022] PUT /identity/v3/projects/2b24275f80e6401d8bb82452ef943cce/users/4bea52e6b5104781a3cea5d9a7cff484/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:59.370198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5988d8-a519-46c1-aeaa-c1f5c313d225 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:59.370492 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5988d8-a519-46c1-aeaa-c1f5c313d225 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:59.370756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5988d8-a519-46c1-aeaa-c1f5c313d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:59.378749 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:59.399191 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cb5988d8-a519-46c1-aeaa-c1f5c313d225 None None] MFA Rules not processed for user `4bea52e6b5104781a3cea5d9a7cff484`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:59.406997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cb5988d8-a519-46c1-aeaa-c1f5c313d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:59.468957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1338/2709] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:10:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:59.481370 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bf9ab-c9dc-4bd2-8326-005bf1362c7b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:59.483150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7e4bf9ab-c9dc-4bd2-8326-005bf1362c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:59.543476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bf9ab-c9dc-4bd2-8326-005bf1362c7b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:59.547290 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bed534-d8db-4949-9155-5600e4a092c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:59.547883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bed534-d8db-4949-9155-5600e4a092c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:59.548155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bed534-d8db-4949-9155-5600e4a092c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:59.548420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bed534-d8db-4949-9155-5600e4a092c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:59.606038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bed534-d8db-4949-9155-5600e4a092c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:59.607519 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bed534-d8db-4949-9155-5600e4a092c3 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:59.624093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1372/2710] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:01.739585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5988d8-a519-46c1-aeaa-c1f5c313d225 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:01.741373 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cb5988d8-a519-46c1-aeaa-c1f5c313d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:01.810270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5988d8-a519-46c1-aeaa-c1f5c313d225 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:01.814994 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bed534-d8db-4949-9155-5600e4a092c3 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:01.815684 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:01.819086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:01.819238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-36bed534-d8db-4949-9155-5600e4a092c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:01.819358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:01.819358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] PATH_INFO: `/v3/users/ba73039e41a04a9aa3d9d713f5d72840` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:01.819358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba73039e41a04a9aa3d9d713f5d72840)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:01.820324 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:01.833234 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bed534-d8db-4949-9155-5600e4a092c3 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:01.838045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:01.841508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:01.841508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:01.841508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] PATH_INFO: `/v3/users/ccd9d4fa48014b6cab055ce58a6be7e3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:01.841508 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd9d4fa48014b6cab055ce58a6be7e3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:01.842612 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:02.020563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba73039e41a04a9aa3d9d713f5d72840'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.027973 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba73039e41a04a9aa3d9d713f5d72840'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.028644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba73039e41a04a9aa3d9d713f5d72840'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.029281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba73039e41a04a9aa3d9d713f5d72840'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.052764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd9d4fa48014b6cab055ce58a6be7e3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.053433 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd9d4fa48014b6cab055ce58a6be7e3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.054088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd9d4fa48014b6cab055ce58a6be7e3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.056857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:02.083550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfad2379-c9c9-4bfe-9756-c69788a54aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba73039e41a04a9aa3d9d713f5d72840'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.102125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1339/2711] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:01 2022] DELETE /identity/v3/users/ba73039e41a04a9aa3d9d713f5d72840 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:02.106615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3b94c-29ef-4095-8026-914ef6638127 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:02.106902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3b94c-29ef-4095-8026-914ef6638127 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:02.107176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3b94c-29ef-4095-8026-914ef6638127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:02.125782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-bcb3b94c-29ef-4095-8026-914ef6638127 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:02.126984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bcb3b94c-29ef-4095-8026-914ef6638127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:02.130913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:02.186607 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1340/2712] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:02.197272 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3b94c-29ef-4095-8026-914ef6638127 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:02.198622 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bcb3b94c-29ef-4095-8026-914ef6638127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:02.203415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd9d4fa48014b6cab055ce58a6be7e3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.217522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5fb361be-e930-45bb-bb79-207796a0d759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd9d4fa48014b6cab055ce58a6be7e3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:02.230114 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1373/2713] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:01 2022] DELETE /identity/v3/users/ccd9d4fa48014b6cab055ce58a6be7e3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:02.234531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207083-c426-44bc-973f-c94fab8a47a6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:02.234814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207083-c426-44bc-973f-c94fab8a47a6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:02.235625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf207083-c426-44bc-973f-c94fab8a47a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:02.254208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-cf207083-c426-44bc-973f-c94fab8a47a6 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:02.255425 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cf207083-c426-44bc-973f-c94fab8a47a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:02.257026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3b94c-29ef-4095-8026-914ef6638127 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:02.311162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227171b2-1eb4-4c65-8939-b3e5b82e0bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:02.312092 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227171b2-1eb4-4c65-8939-b3e5b82e0bbb service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:02.312588 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227171b2-1eb4-4c65-8939-b3e5b82e0bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:02.312860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227171b2-1eb4-4c65-8939-b3e5b82e0bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:02.327730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1374/2714] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:02.340384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207083-c426-44bc-973f-c94fab8a47a6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:02.342002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cf207083-c426-44bc-973f-c94fab8a47a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:02.362635 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf207083-c426-44bc-973f-c94fab8a47a6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:02.363961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf0214-78b2-486b-93ba-b698cff91a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:02.364587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0214-78b2-486b-93ba-b698cff91a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:02.365021 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0214-78b2-486b-93ba-b698cff91a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:02.365303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0214-78b2-486b-93ba-b698cff91a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:02.375839 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf0214-78b2-486b-93ba-b698cff91a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:02.377644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf0214-78b2-486b-93ba-b698cff91a18 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:02.387638 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227171b2-1eb4-4c65-8939-b3e5b82e0bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:02.388630 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1375/2715] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:02.390348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227171b2-1eb4-4c65-8939-b3e5b82e0bbb service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:02.405055 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1341/2716] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:11:02.921696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf0214-78b2-486b-93ba-b698cff91a18 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:02.922145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cecf0214-78b2-486b-93ba-b698cff91a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:02.935527 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf0214-78b2-486b-93ba-b698cff91a18 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:02.940696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:02.941310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:02.941846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:02.942298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] PATH_INFO: `/v3/projects/f9c52083839046ebb0623fdf57492a09` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:02.943956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c52083839046ebb0623fdf57492a09)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:02.950228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:02.953018 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227171b2-1eb4-4c65-8939-b3e5b82e0bbb service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:02.954593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-227171b2-1eb4-4c65-8939-b3e5b82e0bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:02.980815 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227171b2-1eb4-4c65-8939-b3e5b82e0bbb service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:02.989256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:02.989256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:02.989256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:02.989256 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] PATH_INFO: `/v3/projects/2b9a8a84b4ad4bf3a1fe1abc9d90c1d1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:02.990315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9a8a84b4ad4bf3a1fe1abc9d90c1d1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:02.992338 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:03.003572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:03.104546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c52083839046ebb0623fdf57492a09', 'request_id': 'req-92c9daa4-2921-4258-b8f5-889092f3874c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.109916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c52083839046ebb0623fdf57492a09', 'request_id': 'req-92c9daa4-2921-4258-b8f5-889092f3874c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.116415 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c52083839046ebb0623fdf57492a09', 'request_id': 'req-92c9daa4-2921-4258-b8f5-889092f3874c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.146051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9a8a84b4ad4bf3a1fe1abc9d90c1d1', 'request_id': 'req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.152129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9a8a84b4ad4bf3a1fe1abc9d90c1d1', 'request_id': 'req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.158687 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9a8a84b4ad4bf3a1fe1abc9d90c1d1', 'request_id': 'req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.225846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] The token cache is being invalidate because project f9c52083839046ebb0623fdf57492a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:03.226268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.226887 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.229004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1376/2717] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:02 2022] DELETE /identity/v3/projects/f9c52083839046ebb0623fdf57492a09 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:03.232760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:03.234069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:03.277723 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:03.299984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9daa4-2921-4258-b8f5-889092f3874c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:03.320772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] The token cache is being invalidate because project 2b9a8a84b4ad4bf3a1fe1abc9d90c1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:03.320772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.320772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.320772 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1342/2718] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:02 2022] DELETE /identity/v3/projects/2b9a8a84b4ad4bf3a1fe1abc9d90c1d1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:03.323543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:03.325260 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:03.374344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:03.374993 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:03.375279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:03.375555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] PATH_INFO: `/v3/users/ae5e24fb660f432eb4cb37552c72789a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:03.376888 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5e24fb660f432eb4cb37552c72789a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:03.378852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:03.428086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f4735-dea2-4be3-be5d-7462e39d1fe2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:03.433736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:03.434389 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:03.434660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:03.434929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] PATH_INFO: `/v3/users/5d47ea38b34543cabf6ba9878500227f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:03.436059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d47ea38b34543cabf6ba9878500227f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:03.438032 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:03.729259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5e24fb660f432eb4cb37552c72789a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.730071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5e24fb660f432eb4cb37552c72789a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.730721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5e24fb660f432eb4cb37552c72789a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.731651 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d47ea38b34543cabf6ba9878500227f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.738924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d47ea38b34543cabf6ba9878500227f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.739600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d47ea38b34543cabf6ba9878500227f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.740198 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d47ea38b34543cabf6ba9878500227f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.885542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5e24fb660f432eb4cb37552c72789a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.899729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5e24fb660f432eb4cb37552c72789a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:03.916808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1377/2719] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:03 2022] DELETE /identity/v3/users/ae5e24fb660f432eb4cb37552c72789a => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:03.916808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:03.916808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:03.985990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d47ea38b34543cabf6ba9878500227f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.011682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1343/2720] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:03 2022] DELETE /identity/v3/users/5d47ea38b34543cabf6ba9878500227f => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:04.031379 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e9242-4e26-47a8-a95a-fe21641c843b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:04.103155 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:04.103920 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.104204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.104468 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.106331 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:04.118192 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:04.133654 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:04.146865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:04.156125 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1378/2721] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:04.463359 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:04.464919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:04.492699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:04.540026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46eef9-f3b0-4921-877b-4212b7ca9957 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:04.545705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:04.547912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.547912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.547912 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] PATH_INFO: `/v3/projects/9cc6ad8a10ac4e0995f656d73ffe719a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.549156 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc6ad8a10ac4e0995f656d73ffe719a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:04.551291 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:04.660938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:04.674083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:04.674238 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc6ad8a10ac4e0995f656d73ffe719a', 'request_id': 'req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.681816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc6ad8a10ac4e0995f656d73ffe719a', 'request_id': 'req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.691512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc6ad8a10ac4e0995f656d73ffe719a', 'request_id': 'req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.691858 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51974a-dc01-46aa-b81a-d7eea13929e4 service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:04.752056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:04.752688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.752968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.753242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] PATH_INFO: `/v3/projects/1e5d0aec1db7473cb93566e4ef19bc4f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.754510 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5d0aec1db7473cb93566e4ef19bc4f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:04.756442 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:04.817883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] The token cache is being invalidate because project 9cc6ad8a10ac4e0995f656d73ffe719a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:04.818207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.818837 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5b335a7c-ac9a-49fb-97b4-5342b7a373c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.820353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1344/2722] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:04 2022] DELETE /identity/v3/projects/9cc6ad8a10ac4e0995f656d73ffe719a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:04.825821 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6f039-be58-42de-bf84-913732151ac9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.826104 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6f039-be58-42de-bf84-913732151ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.826381 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6f039-be58-42de-bf84-913732151ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.845348 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7fe6f039-be58-42de-bf84-913732151ac9 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:04.846444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7fe6f039-be58-42de-bf84-913732151ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:04.854402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1345/2723] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:04.866879 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32be9de-59e5-4bbe-9be6-19e6c60aaeab None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.867161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32be9de-59e5-4bbe-9be6-19e6c60aaeab None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.867437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32be9de-59e5-4bbe-9be6-19e6c60aaeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.887106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b32be9de-59e5-4bbe-9be6-19e6c60aaeab None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:04.888271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b32be9de-59e5-4bbe-9be6-19e6c60aaeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:04.896114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1346/2724] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:04.900035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32be9de-59e5-4bbe-9be6-19e6c60aaeab None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:04.908569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32be9de-59e5-4bbe-9be6-19e6c60aaeab None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:04.913210 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa7beb-a8b1-4ab6-80cc-08262c208d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:04.913816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa7beb-a8b1-4ab6-80cc-08262c208d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.914095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa7beb-a8b1-4ab6-80cc-08262c208d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.914401 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa7beb-a8b1-4ab6-80cc-08262c208d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.915029 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa7beb-a8b1-4ab6-80cc-08262c208d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:04.915323 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa7beb-a8b1-4ab6-80cc-08262c208d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:04.916894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa7beb-a8b1-4ab6-80cc-08262c208d0e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:04.928192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1347/2725] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:11:04.932930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa7beb-a8b1-4ab6-80cc-08262c208d0e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:04.934859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5d0aec1db7473cb93566e4ef19bc4f', 'request_id': 'req-1f2cf7fe-dad2-495c-acb5-e178b149e20f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.940476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5d0aec1db7473cb93566e4ef19bc4f', 'request_id': 'req-1f2cf7fe-dad2-495c-acb5-e178b149e20f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.942517 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa7beb-a8b1-4ab6-80cc-08262c208d0e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:04.948981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5d0aec1db7473cb93566e4ef19bc4f', 'request_id': 'req-1f2cf7fe-dad2-495c-acb5-e178b149e20f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:04.999988 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8673-8870-483b-b252-5c2e112a8684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.000546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8673-8870-483b-b252-5c2e112a8684 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.000769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8673-8870-483b-b252-5c2e112a8684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.001035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8673-8870-483b-b252-5c2e112a8684 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.001674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8673-8870-483b-b252-5c2e112a8684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.003545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8673-8870-483b-b252-5c2e112a8684 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.041184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] The token cache is being invalidate because project 1e5d0aec1db7473cb93566e4ef19bc4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:05.041807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:05.042327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1f2cf7fe-dad2-495c-acb5-e178b149e20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:05.044039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1379/2726] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:04 2022] DELETE /identity/v3/projects/1e5d0aec1db7473cb93566e4ef19bc4f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:05.048674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abfc5b-d9d3-4dbc-8dde-36680be094a5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.048999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abfc5b-d9d3-4dbc-8dde-36680be094a5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.049273 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abfc5b-d9d3-4dbc-8dde-36680be094a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.068868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-74abfc5b-d9d3-4dbc-8dde-36680be094a5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:05.070087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-74abfc5b-d9d3-4dbc-8dde-36680be094a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.077981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1380/2727] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:05.085646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428873-d0a1-4162-9749-4d15da4386ed None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.085928 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428873-d0a1-4162-9749-4d15da4386ed None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.086191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428873-d0a1-4162-9749-4d15da4386ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.106026 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-50428873-d0a1-4162-9749-4d15da4386ed None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:05.107208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-50428873-d0a1-4162-9749-4d15da4386ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.115200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1381/2728] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:05.120320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50428873-d0a1-4162-9749-4d15da4386ed None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.129213 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50428873-d0a1-4162-9749-4d15da4386ed None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.132300 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1348/2729] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:04 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:05.136755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8673-8870-483b-b252-5c2e112a8684 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.137343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2b2f6-59fd-4efb-87ff-dc272cdf8538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.138043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2b2f6-59fd-4efb-87ff-dc272cdf8538 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.138494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2b2f6-59fd-4efb-87ff-dc272cdf8538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.138767 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2b2f6-59fd-4efb-87ff-dc272cdf8538 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.139296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2f0e8673-8870-483b-b252-5c2e112a8684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.139478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2b2f6-59fd-4efb-87ff-dc272cdf8538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:05.139783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2b2f6-59fd-4efb-87ff-dc272cdf8538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.141365 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2b2f6-59fd-4efb-87ff-dc272cdf8538 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.154982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1382/2730] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:11:05.160079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:05.161310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2b2f6-59fd-4efb-87ff-dc272cdf8538 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.174575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2b2f6-59fd-4efb-87ff-dc272cdf8538 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.231899 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8673-8870-483b-b252-5c2e112a8684 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.240203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924ea20-e0e3-4318-82b4-4ce9fc4332f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.241001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924ea20-e0e3-4318-82b4-4ce9fc4332f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.241504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924ea20-e0e3-4318-82b4-4ce9fc4332f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.241770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924ea20-e0e3-4318-82b4-4ce9fc4332f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.244719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924ea20-e0e3-4318-82b4-4ce9fc4332f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.246873 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924ea20-e0e3-4318-82b4-4ce9fc4332f0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.249325 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7772a-464d-4cd3-8944-99f9c60fb704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.250359 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7772a-464d-4cd3-8944-99f9c60fb704 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.250646 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7772a-464d-4cd3-8944-99f9c60fb704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.250983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7772a-464d-4cd3-8944-99f9c60fb704 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.251674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7772a-464d-4cd3-8944-99f9c60fb704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.263311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7772a-464d-4cd3-8944-99f9c60fb704 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.375284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1349/2731] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:05.375284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924ea20-e0e3-4318-82b4-4ce9fc4332f0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.375649 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1924ea20-e0e3-4318-82b4-4ce9fc4332f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.376793 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1383/2732] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:05.377758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7772a-464d-4cd3-8944-99f9c60fb704 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.435488 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924ea20-e0e3-4318-82b4-4ce9fc4332f0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.442758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7772a-464d-4cd3-8944-99f9c60fb704 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.449176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bb5f3-7c91-41da-9630-85073b4acd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.450067 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bb5f3-7c91-41da-9630-85073b4acd0e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.450257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bb5f3-7c91-41da-9630-85073b4acd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.450522 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bb5f3-7c91-41da-9630-85073b4acd0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.451449 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bb5f3-7c91-41da-9630-85073b4acd0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.453074 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bb5f3-7c91-41da-9630-85073b4acd0e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.463965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1384/2733] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:05.464956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bb5f3-7c91-41da-9630-85073b4acd0e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.474997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bb5f3-7c91-41da-9630-85073b4acd0e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.480671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eea66-e992-4be9-8b48-fc0cc59915eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.481252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eea66-e992-4be9-8b48-fc0cc59915eb admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.481556 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eea66-e992-4be9-8b48-fc0cc59915eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.481973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eea66-e992-4be9-8b48-fc0cc59915eb admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.482430 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eea66-e992-4be9-8b48-fc0cc59915eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.484307 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eea66-e992-4be9-8b48-fc0cc59915eb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.489023 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1b65c-88f8-4729-adcd-689608ce83f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.489719 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1b65c-88f8-4729-adcd-689608ce83f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.489999 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1b65c-88f8-4729-adcd-689608ce83f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.490280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1b65c-88f8-4729-adcd-689608ce83f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.492396 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-efb1b65c-88f8-4729-adcd-689608ce83f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.529351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:05.555726 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1b65c-88f8-4729-adcd-689608ce83f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.557182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1b65c-88f8-4729-adcd-689608ce83f2 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.566771 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1350/2734] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:05.568105 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1b65c-88f8-4729-adcd-689608ce83f2 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.577676 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1b65c-88f8-4729-adcd-689608ce83f2 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.582326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b4df2-5a80-4df7-8cac-d6f3431fcd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.582908 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b4df2-5a80-4df7-8cac-d6f3431fcd60 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.583180 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b4df2-5a80-4df7-8cac-d6f3431fcd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.583447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b4df2-5a80-4df7-8cac-d6f3431fcd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.584091 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b4df2-5a80-4df7-8cac-d6f3431fcd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.585746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b4df2-5a80-4df7-8cac-d6f3431fcd60 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.596816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1385/2735] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:05.597200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1351/2736] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:05.600874 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b4df2-5a80-4df7-8cac-d6f3431fcd60 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.601198 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eea66-e992-4be9-8b48-fc0cc59915eb admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.612459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b4df2-5a80-4df7-8cac-d6f3431fcd60 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.614552 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eea66-e992-4be9-8b48-fc0cc59915eb admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.619233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b1ea9-ca85-4591-b6d0-452e81a6e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.619905 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b1ea9-ca85-4591-b6d0-452e81a6e78c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.620179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b1ea9-ca85-4591-b6d0-452e81a6e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.620449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b1ea9-ca85-4591-b6d0-452e81a6e78c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.621088 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b1ea9-ca85-4591-b6d0-452e81a6e78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.621202 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837719db-b411-4964-84e8-222d0bb837c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.621948 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837719db-b411-4964-84e8-222d0bb837c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.622409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837719db-b411-4964-84e8-222d0bb837c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.622684 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837719db-b411-4964-84e8-222d0bb837c1 admin admin] PATH_INFO: `/v3/projects/ed8dc2c2307c44e7b82995ac805961b2/users/dc14e1a7084747e4b857d9e64dd6d563/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.622872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b1ea9-ca85-4591-b6d0-452e81a6e78c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.633293 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1352/2737] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:11:05.637221 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b1ea9-ca85-4591-b6d0-452e81a6e78c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.640709 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837719db-b411-4964-84e8-222d0bb837c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8dc2c2307c44e7b82995ac805961b2, user_id=dc14e1a7084747e4b857d9e64dd6d563, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.643398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837719db-b411-4964-84e8-222d0bb837c1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.648575 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b1ea9-ca85-4591-b6d0-452e81a6e78c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.652688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb01212-da27-4c55-8bad-01df50dd9206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.653294 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01212-da27-4c55-8bad-01df50dd9206 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.653600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01212-da27-4c55-8bad-01df50dd9206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.653894 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01212-da27-4c55-8bad-01df50dd9206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.654636 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb01212-da27-4c55-8bad-01df50dd9206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.656204 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb01212-da27-4c55-8bad-01df50dd9206 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.667622 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1353/2738] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:05.671691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb01212-da27-4c55-8bad-01df50dd9206 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.681031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb01212-da27-4c55-8bad-01df50dd9206 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.685646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0812658-1726-49df-92cf-e0237bf37d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.686274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812658-1726-49df-92cf-e0237bf37d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.686543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812658-1726-49df-92cf-e0237bf37d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.686808 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812658-1726-49df-92cf-e0237bf37d19 admin admin] PATH_INFO: `/v3/projects/e59091d3695c4e18a5a62ac13d3aa383/users/fa98a8c07fae4a74872a297920092a48/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.702516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0812658-1726-49df-92cf-e0237bf37d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59091d3695c4e18a5a62ac13d3aa383, user_id=fa98a8c07fae4a74872a297920092a48, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.706187 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0812658-1726-49df-92cf-e0237bf37d19 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.730772 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1386/2739] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:05 2022] PUT /identity/v3/projects/ed8dc2c2307c44e7b82995ac805961b2/users/dc14e1a7084747e4b857d9e64dd6d563/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:05.742699 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f8b6e-6b4a-43a2-b12e-342434f33d86 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.743030 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f8b6e-6b4a-43a2-b12e-342434f33d86 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.743294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f8b6e-6b4a-43a2-b12e-342434f33d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.769848 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-dc7f8b6e-6b4a-43a2-b12e-342434f33d86 None None] MFA Rules not processed for user `dc14e1a7084747e4b857d9e64dd6d563`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:05.771037 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-dc7f8b6e-6b4a-43a2-b12e-342434f33d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.792007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1354/2740] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:05 2022] PUT /identity/v3/projects/e59091d3695c4e18a5a62ac13d3aa383/users/fa98a8c07fae4a74872a297920092a48/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:05.803443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3aee0-77c4-43bf-9b64-e420bae05f93 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.803847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3aee0-77c4-43bf-9b64-e420bae05f93 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.804182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3aee0-77c4-43bf-9b64-e420bae05f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.837499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d9a3aee0-77c4-43bf-9b64-e420bae05f93 None None] MFA Rules not processed for user `fa98a8c07fae4a74872a297920092a48`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:05.838097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1387/2741] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:05.838833 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d9a3aee0-77c4-43bf-9b64-e420bae05f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.842760 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f8b6e-6b4a-43a2-b12e-342434f33d86 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.903808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f8b6e-6b4a-43a2-b12e-342434f33d86 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.908179 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1355/2742] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:05.915998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3aee0-77c4-43bf-9b64-e420bae05f93 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.917403 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d9a3aee0-77c4-43bf-9b64-e420bae05f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.924476 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:05.965035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4a9c-5bd4-462f-9e90-bd82bde33791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.965691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4a9c-5bd4-462f-9e90-bd82bde33791 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.965972 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4a9c-5bd4-462f-9e90-bd82bde33791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.966242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4a9c-5bd4-462f-9e90-bd82bde33791 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.966859 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf4a9c-5bd4-462f-9e90-bd82bde33791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.968761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf4a9c-5bd4-462f-9e90-bd82bde33791 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.977073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3aee0-77c4-43bf-9b64-e420bae05f93 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.981443 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab38e0-9919-46d8-9ec2-14acffaab557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.982106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab38e0-9919-46d8-9ec2-14acffaab557 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.982385 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab38e0-9919-46d8-9ec2-14acffaab557 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.982699 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab38e0-9919-46d8-9ec2-14acffaab557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.991402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab38e0-9919-46d8-9ec2-14acffaab557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.992823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab38e0-9919-46d8-9ec2-14acffaab557 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:06.001753 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1356/2743] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:11:06.101984 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1388/2744] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:06.106173 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab38e0-9919-46d8-9ec2-14acffaab557 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:06.117328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab38e0-9919-46d8-9ec2-14acffaab557 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:06.175861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cb97-6536-419b-a56a-6de9afa70f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:06.176461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cb97-6536-419b-a56a-6de9afa70f7c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:06.176733 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cb97-6536-419b-a56a-6de9afa70f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:06.177014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cb97-6536-419b-a56a-6de9afa70f7c admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:06.177655 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cb97-6536-419b-a56a-6de9afa70f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:06.179570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cb97-6536-419b-a56a-6de9afa70f7c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:06.254990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:06.329234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1357/2745] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:06 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:06.332530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4a9c-5bd4-462f-9e90-bd82bde33791 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:06.343064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4a9c-5bd4-462f-9e90-bd82bde33791 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:06.347671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff1ee1-da7f-46aa-bd7c-76b92c6aa4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:06.348265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff1ee1-da7f-46aa-bd7c-76b92c6aa4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:06.348543 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff1ee1-da7f-46aa-bd7c-76b92c6aa4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:06.348815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff1ee1-da7f-46aa-bd7c-76b92c6aa4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:06.349452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff1ee1-da7f-46aa-bd7c-76b92c6aa4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:06.351139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff1ee1-da7f-46aa-bd7c-76b92c6aa4b7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:06.366874 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1389/2746] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:06.371310 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cb97-6536-419b-a56a-6de9afa70f7c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:06.381998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cb97-6536-419b-a56a-6de9afa70f7c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:06.389659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1bb57-4ba9-49ae-bdeb-51c441f4d403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:06.390337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1bb57-4ba9-49ae-bdeb-51c441f4d403 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:06.390611 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1bb57-4ba9-49ae-bdeb-51c441f4d403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:06.390882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1bb57-4ba9-49ae-bdeb-51c441f4d403 admin admin] PATH_INFO: `/v3/projects/b1f0690bbd2d4d74a441884053ca872e/users/1b8630a023314c789624881b9cc9b82d/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:06.405993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1bb57-4ba9-49ae-bdeb-51c441f4d403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f0690bbd2d4d74a441884053ca872e, user_id=1b8630a023314c789624881b9cc9b82d, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:06.408635 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1bb57-4ba9-49ae-bdeb-51c441f4d403 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:06.525033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1358/2747] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:06 2022] PUT /identity/v3/projects/b1f0690bbd2d4d74a441884053ca872e/users/1b8630a023314c789624881b9cc9b82d/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:06.529165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff1ee1-da7f-46aa-bd7c-76b92c6aa4b7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:06.540541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff1ee1-da7f-46aa-bd7c-76b92c6aa4b7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:06.575367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:06.603814 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b11c92-ea5e-4afe-b098-6b43f5297c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:06.604343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b11c92-ea5e-4afe-b098-6b43f5297c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:06.604618 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b11c92-ea5e-4afe-b098-6b43f5297c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:06.604883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b11c92-ea5e-4afe-b098-6b43f5297c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:06.605554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b11c92-ea5e-4afe-b098-6b43f5297c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:06.607157 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b11c92-ea5e-4afe-b098-6b43f5297c0b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:06.616869 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1390/2748] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:06.621853 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1bb57-4ba9-49ae-bdeb-51c441f4d403 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:06.632175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1bb57-4ba9-49ae-bdeb-51c441f4d403 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:06.639296 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28990ec9-1dc6-4928-b248-10bf0cde96a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:06.640047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28990ec9-1dc6-4928-b248-10bf0cde96a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:06.640388 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28990ec9-1dc6-4928-b248-10bf0cde96a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:06.640722 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28990ec9-1dc6-4928-b248-10bf0cde96a2 admin admin] PATH_INFO: `/v3/projects/b1f0690bbd2d4d74a441884053ca872e/users/1b8630a023314c789624881b9cc9b82d/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:06.642920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28990ec9-1dc6-4928-b248-10bf0cde96a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f0690bbd2d4d74a441884053ca872e, user_id=1b8630a023314c789624881b9cc9b82d, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:06.645713 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28990ec9-1dc6-4928-b248-10bf0cde96a2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:06.656392 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1359/2749] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:06 2022] PUT /identity/v3/projects/b1f0690bbd2d4d74a441884053ca872e/users/1b8630a023314c789624881b9cc9b82d/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:06.667494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a7e3-c72c-41d9-9388-8704f312bd2a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:06.667777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a7e3-c72c-41d9-9388-8704f312bd2a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:06.668176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a7e3-c72c-41d9-9388-8704f312bd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:06.690233 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:06.701406 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-42c5a7e3-c72c-41d9-9388-8704f312bd2a None None] MFA Rules not processed for user `1b8630a023314c789624881b9cc9b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:06.702718 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-42c5a7e3-c72c-41d9-9388-8704f312bd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:06.803027 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1391/2750] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:06.822798 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28990ec9-1dc6-4928-b248-10bf0cde96a2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:06.876504 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5a7e3-c72c-41d9-9388-8704f312bd2a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:06.878535 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-42c5a7e3-c72c-41d9-9388-8704f312bd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:06.915998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28990ec9-1dc6-4928-b248-10bf0cde96a2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:06.920397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b8a7-b51d-46f4-895f-6821867e8da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:06.921268 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b8a7-b51d-46f4-895f-6821867e8da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:06.921810 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b8a7-b51d-46f4-895f-6821867e8da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:06.922246 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186b8a7-b51d-46f4-895f-6821867e8da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:06.934012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186b8a7-b51d-46f4-895f-6821867e8da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:06.936449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186b8a7-b51d-46f4-895f-6821867e8da2 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:06.948819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1360/2751] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:06.997650 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5a7e3-c72c-41d9-9388-8704f312bd2a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:07.001587 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98feff7-5d2f-4cbe-837c-5a0eb665f261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:07.002197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98feff7-5d2f-4cbe-837c-5a0eb665f261 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:07.002502 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98feff7-5d2f-4cbe-837c-5a0eb665f261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:07.002775 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98feff7-5d2f-4cbe-837c-5a0eb665f261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:07.004595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a98feff7-5d2f-4cbe-837c-5a0eb665f261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:07.015221 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98feff7-5d2f-4cbe-837c-5a0eb665f261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:07.016657 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98feff7-5d2f-4cbe-837c-5a0eb665f261 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:07.025877 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1392/2752] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:07.098504 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b8a7-b51d-46f4-895f-6821867e8da2 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:07.159920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186b8a7-b51d-46f4-895f-6821867e8da2 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:07.164555 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:07.165292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:07.165705 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:07.165978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] PATH_INFO: `/v3/users/dc14e1a7084747e4b857d9e64dd6d563` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:07.167140 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc14e1a7084747e4b857d9e64dd6d563)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:07.169047 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:07.417255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc14e1a7084747e4b857d9e64dd6d563'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:07.424106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc14e1a7084747e4b857d9e64dd6d563'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:07.424871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc14e1a7084747e4b857d9e64dd6d563'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:07.425477 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc14e1a7084747e4b857d9e64dd6d563'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:07.443552 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:07.498058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc14e1a7084747e4b857d9e64dd6d563'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:07.518202 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1361/2753] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:07 2022] DELETE /identity/v3/users/dc14e1a7084747e4b857d9e64dd6d563 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:07.522949 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5120f7-6e46-4e58-b9f7-0aa372d9eaba None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:07.523607 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5120f7-6e46-4e58-b9f7-0aa372d9eaba None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:07.523887 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5120f7-6e46-4e58-b9f7-0aa372d9eaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:07.545446 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2f5120f7-6e46-4e58-b9f7-0aa372d9eaba None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:07.546721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2f5120f7-6e46-4e58-b9f7-0aa372d9eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:07.581817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:07.613238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1393/2754] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:07.624353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:07.625795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:07.687520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e0add-fd7d-4a2e-9033-e9eaf99421da admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:07.692114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcdfed-9c3e-444f-828f-454cfb747dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:07.692716 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcdfed-9c3e-444f-828f-454cfb747dfe service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:07.693168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcdfed-9c3e-444f-828f-454cfb747dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:07.694365 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcdfed-9c3e-444f-828f-454cfb747dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:07.704152 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcdfed-9c3e-444f-828f-454cfb747dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:07.705663 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcdfed-9c3e-444f-828f-454cfb747dfe service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:07.716052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1362/2755] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:08.121375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5120f7-6e46-4e58-b9f7-0aa372d9eaba None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:08.122841 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2f5120f7-6e46-4e58-b9f7-0aa372d9eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:08.136304 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5120f7-6e46-4e58-b9f7-0aa372d9eaba None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:08.140004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea1743-675b-436f-a632-f1d5843a2fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:08.140632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1743-675b-436f-a632-f1d5843a2fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:08.140908 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1743-675b-436f-a632-f1d5843a2fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:08.141197 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea1743-675b-436f-a632-f1d5843a2fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:08.142945 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-53ea1743-675b-436f-a632-f1d5843a2fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:08.208828 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcdfed-9c3e-444f-828f-454cfb747dfe service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:08.217444 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-08dcdfed-9c3e-444f-828f-454cfb747dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:08.242953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcdfed-9c3e-444f-828f-454cfb747dfe service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:08.248514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:08.249157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:08.249437 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:08.249740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] PATH_INFO: `/v3/projects/ed8dc2c2307c44e7b82995ac805961b2` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:08.251315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8dc2c2307c44e7b82995ac805961b2)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:08.253247 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:08.255119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea1743-675b-436f-a632-f1d5843a2fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:08.256660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea1743-675b-436f-a632-f1d5843a2fb7 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:08.279070 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1394/2756] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:08.446736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8dc2c2307c44e7b82995ac805961b2', 'request_id': 'req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:08.452006 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8dc2c2307c44e7b82995ac805961b2', 'request_id': 'req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:08.458301 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8dc2c2307c44e7b82995ac805961b2', 'request_id': 'req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:08.574012 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] The token cache is being invalidate because project ed8dc2c2307c44e7b82995ac805961b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:08.574306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:08.574952 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:08.576454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1363/2757] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:08 2022] DELETE /identity/v3/projects/ed8dc2c2307c44e7b82995ac805961b2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:08.580501 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea1743-675b-436f-a632-f1d5843a2fb7 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:08.591910 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea1743-675b-436f-a632-f1d5843a2fb7 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:08.648852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:08.650034 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:08.650308 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:08.650575 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] PATH_INFO: `/v3/users/1b8630a023314c789624881b9cc9b82d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:08.651714 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8630a023314c789624881b9cc9b82d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:08.653781 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:08.917746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:08.925682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8630a023314c789624881b9cc9b82d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:08.926337 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8630a023314c789624881b9cc9b82d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:08.926956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8630a023314c789624881b9cc9b82d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:09.035130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8630a023314c789624881b9cc9b82d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:09.047894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-04016631-ad16-4871-8c83-3bdd885fa53f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8630a023314c789624881b9cc9b82d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:09.059929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1395/2758] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:08 2022] DELETE /identity/v3/users/1b8630a023314c789624881b9cc9b82d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:09.500093 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:09.501646 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:09.518133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fff481-7aad-4440-9aa2-a6b6dd42b4e0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:09.560390 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:09.584315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:09.584877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:09.585158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:09.585430 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] PATH_INFO: `/v3/projects/b1f0690bbd2d4d74a441884053ca872e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:09.586777 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f0690bbd2d4d74a441884053ca872e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:09.588766 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:09.719514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f0690bbd2d4d74a441884053ca872e', 'request_id': 'req-df4969df-332e-4c42-8d0e-18eff8417a45'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:09.725065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f0690bbd2d4d74a441884053ca872e', 'request_id': 'req-df4969df-332e-4c42-8d0e-18eff8417a45'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:09.732606 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f0690bbd2d4d74a441884053ca872e', 'request_id': 'req-df4969df-332e-4c42-8d0e-18eff8417a45'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:09.801325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] The token cache is being invalidate because project b1f0690bbd2d4d74a441884053ca872e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:09.806454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:09.806454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-df4969df-332e-4c42-8d0e-18eff8417a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:09.806454 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1364/2759] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:09 2022] DELETE /identity/v3/projects/b1f0690bbd2d4d74a441884053ca872e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:09.811581 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd070-bfe1-44d2-b69d-c9304bb14745 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:09.812079 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd070-bfe1-44d2-b69d-c9304bb14745 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:09.812409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd070-bfe1-44d2-b69d-c9304bb14745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:09.832407 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9cfbd070-bfe1-44d2-b69d-c9304bb14745 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:09.833687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9cfbd070-bfe1-44d2-b69d-c9304bb14745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:09.895396 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1396/2760] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:09.903369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a118-10b1-42a8-8957-30946a17d9fc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:09.903647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a118-10b1-42a8-8957-30946a17d9fc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:09.903915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545a118-10b1-42a8-8957-30946a17d9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:09.924519 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5545a118-10b1-42a8-8957-30946a17d9fc None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:09.925739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5545a118-10b1-42a8-8957-30946a17d9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:09.934293 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1365/2761] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:09.938555 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbd070-bfe1-44d2-b69d-c9304bb14745 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:09.948350 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbd070-bfe1-44d2-b69d-c9304bb14745 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:09.952909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e04c-1c23-439c-9b80-80364d12b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:09.953531 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e04c-1c23-439c-9b80-80364d12b1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:09.953815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e04c-1c23-439c-9b80-80364d12b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:09.954081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e04c-1c23-439c-9b80-80364d12b1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:09.954789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e04c-1c23-439c-9b80-80364d12b1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:09.955087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e04c-1c23-439c-9b80-80364d12b1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:09.956649 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e04c-1c23-439c-9b80-80364d12b1e5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:09.974216 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1397/2762] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:11:09.975188 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545a118-10b1-42a8-8957-30946a17d9fc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:09.986051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545a118-10b1-42a8-8957-30946a17d9fc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:09.996289 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72554-6f56-4f9b-8459-fbe92852f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:09.997019 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72554-6f56-4f9b-8459-fbe92852f25c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:09.997499 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72554-6f56-4f9b-8459-fbe92852f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:09.997883 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf72554-6f56-4f9b-8459-fbe92852f25c admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:09.998888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72554-6f56-4f9b-8459-fbe92852f25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:10.000805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf72554-6f56-4f9b-8459-fbe92852f25c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:10.122545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1366/2763] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:09 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:10.126546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e04c-1c23-439c-9b80-80364d12b1e5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:10.137265 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e04c-1c23-439c-9b80-80364d12b1e5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:10.196512 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17031cfe-c0a3-474e-bc32-b12c45c71ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:10.197131 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17031cfe-c0a3-474e-bc32-b12c45c71ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:10.197408 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17031cfe-c0a3-474e-bc32-b12c45c71ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:10.197705 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17031cfe-c0a3-474e-bc32-b12c45c71ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:10.198317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17031cfe-c0a3-474e-bc32-b12c45c71ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:10.200209 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17031cfe-c0a3-474e-bc32-b12c45c71ac2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:10.312537 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1398/2764] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:10 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:10.317069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72554-6f56-4f9b-8459-fbe92852f25c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:10.328133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf72554-6f56-4f9b-8459-fbe92852f25c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:10.332830 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc499df-54dc-4e83-b4dc-5f9eff3c315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:10.333526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc499df-54dc-4e83-b4dc-5f9eff3c315c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:10.333802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc499df-54dc-4e83-b4dc-5f9eff3c315c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:10.334071 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc499df-54dc-4e83-b4dc-5f9eff3c315c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:10.334711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc499df-54dc-4e83-b4dc-5f9eff3c315c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:10.336343 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc499df-54dc-4e83-b4dc-5f9eff3c315c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:10.347847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1367/2765] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:10.351946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17031cfe-c0a3-474e-bc32-b12c45c71ac2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:10.362166 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17031cfe-c0a3-474e-bc32-b12c45c71ac2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:10.367191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0119c-2e13-4548-92da-0569e31c7184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:10.372985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0119c-2e13-4548-92da-0569e31c7184 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:10.372985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0119c-2e13-4548-92da-0569e31c7184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:10.372985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0119c-2e13-4548-92da-0569e31c7184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:10.372985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0119c-2e13-4548-92da-0569e31c7184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:10.372985 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0119c-2e13-4548-92da-0569e31c7184 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:10.385493 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1399/2766] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:10.386813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc499df-54dc-4e83-b4dc-5f9eff3c315c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:10.401627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc499df-54dc-4e83-b4dc-5f9eff3c315c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:10.402011 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c8150-6199-4366-acfe-aa9293f81815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:10.402657 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8150-6199-4366-acfe-aa9293f81815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:10.402928 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8150-6199-4366-acfe-aa9293f81815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:10.403196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c8150-6199-4366-acfe-aa9293f81815 admin admin] PATH_INFO: `/v3/projects/c4d7969967d44870a4f32b39082787d6/users/e0982da2626c4f3ab93ef6bd41164b0c/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:10.417957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c8150-6199-4366-acfe-aa9293f81815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7969967d44870a4f32b39082787d6, user_id=e0982da2626c4f3ab93ef6bd41164b0c, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:10.420623 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c8150-6199-4366-acfe-aa9293f81815 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:10.510357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1368/2767] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:10 2022] PUT /identity/v3/projects/c4d7969967d44870a4f32b39082787d6/users/e0982da2626c4f3ab93ef6bd41164b0c/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:10.512467 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31164a9-9b0e-4588-9bf8-9ee9ecd42b0a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:10.512956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31164a9-9b0e-4588-9bf8-9ee9ecd42b0a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:10.513302 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31164a9-9b0e-4588-9bf8-9ee9ecd42b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:10.552487 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d31164a9-9b0e-4588-9bf8-9ee9ecd42b0a None None] MFA Rules not processed for user `e0982da2626c4f3ab93ef6bd41164b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:10.553852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d31164a9-9b0e-4588-9bf8-9ee9ecd42b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:10.562802 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:10.621176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1400/2768] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:10.722674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c8150-6199-4366-acfe-aa9293f81815 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:10.725155 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b99c8150-6199-4366-acfe-aa9293f81815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:10.805141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c8150-6199-4366-acfe-aa9293f81815 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:10.808935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a987d-22c9-48ce-8a89-f4f96e68ba31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:10.809594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a987d-22c9-48ce-8a89-f4f96e68ba31 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:10.809916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a987d-22c9-48ce-8a89-f4f96e68ba31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:10.810133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a987d-22c9-48ce-8a89-f4f96e68ba31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:10.818927 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a987d-22c9-48ce-8a89-f4f96e68ba31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:10.820419 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a987d-22c9-48ce-8a89-f4f96e68ba31 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:10.830702 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1369/2769] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:10.851312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31164a9-9b0e-4588-9bf8-9ee9ecd42b0a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:10.916558 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31164a9-9b0e-4588-9bf8-9ee9ecd42b0a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:10.921240 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:10.921905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:10.922194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:10.922466 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] PATH_INFO: `/v3/users/e0982da2626c4f3ab93ef6bd41164b0c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:10.923593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0982da2626c4f3ab93ef6bd41164b0c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:10.925538 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:11.132692 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0982da2626c4f3ab93ef6bd41164b0c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:11.133867 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0982da2626c4f3ab93ef6bd41164b0c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:11.134568 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0982da2626c4f3ab93ef6bd41164b0c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:11.200532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0982da2626c4f3ab93ef6bd41164b0c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:11.214104 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0982da2626c4f3ab93ef6bd41164b0c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:11.226187 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1401/2770] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:10 2022] DELETE /identity/v3/users/e0982da2626c4f3ab93ef6bd41164b0c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:11.230725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c286d0-512e-4e4a-9913-498083549d46 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:11.231013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c286d0-512e-4e4a-9913-498083549d46 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:11.231337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c286d0-512e-4e4a-9913-498083549d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:11.245117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:11.251307 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f4c286d0-512e-4e4a-9913-498083549d46 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:11.252520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f4c286d0-512e-4e4a-9913-498083549d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:11.310618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1370/2771] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:11.320553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:11.322708 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:11.355482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:11.381429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4f532-4bd3-4e81-b065-355d518e2ea8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:11.385567 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16364499-bffa-45f0-8a21-5f6f90f42df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:11.390288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16364499-bffa-45f0-8a21-5f6f90f42df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:11.390288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16364499-bffa-45f0-8a21-5f6f90f42df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:11.390288 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16364499-bffa-45f0-8a21-5f6f90f42df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:11.395758 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16364499-bffa-45f0-8a21-5f6f90f42df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:11.397175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16364499-bffa-45f0-8a21-5f6f90f42df4 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:11.407105 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1402/2772] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:11.823577 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c286d0-512e-4e4a-9913-498083549d46 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:11.825154 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f4c286d0-512e-4e4a-9913-498083549d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:11.837306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c286d0-512e-4e4a-9913-498083549d46 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:11.841831 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:11.842446 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:11.842717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:11.842984 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] PATH_INFO: `/v3/users/31a3d9f7a45049c694bc48c56d146cf7` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:11.844102 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a3d9f7a45049c694bc48c56d146cf7)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:11.846141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:11.896083 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16364499-bffa-45f0-8a21-5f6f90f42df4 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:11.897545 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-16364499-bffa-45f0-8a21-5f6f90f42df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:11.911194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16364499-bffa-45f0-8a21-5f6f90f42df4 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:11.916715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:11.917418 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:11.917821 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:11.918160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] PATH_INFO: `/v3/projects/c4d7969967d44870a4f32b39082787d6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:11.919857 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d7969967d44870a4f32b39082787d6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:11.922200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:12.092893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a3d9f7a45049c694bc48c56d146cf7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.093127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d7969967d44870a4f32b39082787d6', 'request_id': 'req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.099942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d7969967d44870a4f32b39082787d6', 'request_id': 'req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.100182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a3d9f7a45049c694bc48c56d146cf7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.100850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a3d9f7a45049c694bc48c56d146cf7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.101447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a3d9f7a45049c694bc48c56d146cf7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.106943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d7969967d44870a4f32b39082787d6', 'request_id': 'req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.203621 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8e36885e-9031-423e-aacf-25e4fb74b6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a3d9f7a45049c694bc48c56d146cf7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.223073 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1371/2773] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:11 2022] DELETE /identity/v3/users/31a3d9f7a45049c694bc48c56d146cf7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:12.227361 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f0c30-72d2-4587-b9da-06f622fe6354 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:12.227647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f0c30-72d2-4587-b9da-06f622fe6354 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:12.228031 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f0c30-72d2-4587-b9da-06f622fe6354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:12.248114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a99f0c30-72d2-4587-b9da-06f622fe6354 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:12.249393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a99f0c30-72d2-4587-b9da-06f622fe6354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:12.297878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] The token cache is being invalidate because project c4d7969967d44870a4f32b39082787d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:12.298247 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.298922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:12.300478 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1403/2774] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:11 2022] DELETE /identity/v3/projects/c4d7969967d44870a4f32b39082787d6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:12.316182 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1372/2775] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:12.325968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:12.327532 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:12.431045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6112d5-06e4-4d89-bc90-06d7f7e4834a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:12.496272 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7a1d4-c5a4-4b74-9b83-0aa1c1f89b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:12.496900 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7a1d4-c5a4-4b74-9b83-0aa1c1f89b6d service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:12.497194 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7a1d4-c5a4-4b74-9b83-0aa1c1f89b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:12.497641 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7a1d4-c5a4-4b74-9b83-0aa1c1f89b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:12.507980 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7a1d4-c5a4-4b74-9b83-0aa1c1f89b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:12.510688 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7a1d4-c5a4-4b74-9b83-0aa1c1f89b6d service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:12.521868 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1404/2776] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:13.016132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f0c30-72d2-4587-b9da-06f622fe6354 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:13.018117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a99f0c30-72d2-4587-b9da-06f622fe6354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:13.033069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f0c30-72d2-4587-b9da-06f622fe6354 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:13.037971 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:13.038680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:13.038968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:13.039302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] PATH_INFO: `/v3/projects/2477626b67b54c11be53ef34c3b60557` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:13.041143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2477626b67b54c11be53ef34c3b60557)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:13.047579 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:13.061214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:13.195489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2477626b67b54c11be53ef34c3b60557', 'request_id': 'req-615dab83-5aaa-47a2-a114-6f4ecac2ba51'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.201379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2477626b67b54c11be53ef34c3b60557', 'request_id': 'req-615dab83-5aaa-47a2-a114-6f4ecac2ba51'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.207751 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2477626b67b54c11be53ef34c3b60557', 'request_id': 'req-615dab83-5aaa-47a2-a114-6f4ecac2ba51'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.305234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] The token cache is being invalidate because project 2477626b67b54c11be53ef34c3b60557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:13.305547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.306207 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.307757 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1373/2777] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:13 2022] DELETE /identity/v3/projects/2477626b67b54c11be53ef34c3b60557 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:13.311798 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7a1d4-c5a4-4b74-9b83-0aa1c1f89b6d service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:13.321495 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7a1d4-c5a4-4b74-9b83-0aa1c1f89b6d service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:13.331375 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:13.379515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:13.380087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:13.380366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:13.380645 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] PATH_INFO: `/v3/users/4bea52e6b5104781a3cea5d9a7cff484` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:13.381813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bea52e6b5104781a3cea5d9a7cff484)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:13.383730 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:13.445086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:13.446537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:13.460931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dab83-5aaa-47a2-a114-6f4ecac2ba51 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:13.466644 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:13.467329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:13.467615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:13.467886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] PATH_INFO: `/v3/users/fa98a8c07fae4a74872a297920092a48` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:13.469126 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa98a8c07fae4a74872a297920092a48)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:13.471130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:13.616889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bea52e6b5104781a3cea5d9a7cff484'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.617640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bea52e6b5104781a3cea5d9a7cff484'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.618257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bea52e6b5104781a3cea5d9a7cff484'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.670923 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa98a8c07fae4a74872a297920092a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.677775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa98a8c07fae4a74872a297920092a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.678553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa98a8c07fae4a74872a297920092a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.679183 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa98a8c07fae4a74872a297920092a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.683800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bea52e6b5104781a3cea5d9a7cff484'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.698686 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1e836356-ac7e-497f-8c56-84abd8d7282d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bea52e6b5104781a3cea5d9a7cff484'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.713521 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1405/2778] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:13 2022] DELETE /identity/v3/users/4bea52e6b5104781a3cea5d9a7cff484 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:13.812094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa98a8c07fae4a74872a297920092a48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:13.835350 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1374/2779] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:13 2022] DELETE /identity/v3/users/fa98a8c07fae4a74872a297920092a48 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:13.840060 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e09d8-b5f8-4f72-baf5-f4bee3e3e0db None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:13.840342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e09d8-b5f8-4f72-baf5-f4bee3e3e0db None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:13.840617 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e09d8-b5f8-4f72-baf5-f4bee3e3e0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:13.860813 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-244e09d8-b5f8-4f72-baf5-f4bee3e3e0db None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:13.862038 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-244e09d8-b5f8-4f72-baf5-f4bee3e3e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:13.936603 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1406/2780] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:13.943760 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:13.950604 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:14.044497 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b3914-cf64-4754-92af-0a42adbb23d0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:14.048320 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0bd0a-1990-47f4-9312-0a60e13d6139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:14.049370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0bd0a-1990-47f4-9312-0a60e13d6139 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:14.049370 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0bd0a-1990-47f4-9312-0a60e13d6139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:14.049616 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0bd0a-1990-47f4-9312-0a60e13d6139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:14.061908 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0bd0a-1990-47f4-9312-0a60e13d6139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:14.063436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0bd0a-1990-47f4-9312-0a60e13d6139 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:14.075717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1375/2781] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:14.182460 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e09d8-b5f8-4f72-baf5-f4bee3e3e0db None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:14.183944 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-244e09d8-b5f8-4f72-baf5-f4bee3e3e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:14.201218 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e09d8-b5f8-4f72-baf5-f4bee3e3e0db None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:14.205997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:14.206632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:14.206913 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:14.207182 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] PATH_INFO: `/v3/projects/2b24275f80e6401d8bb82452ef943cce` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:14.209161 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b24275f80e6401d8bb82452ef943cce)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:14.210255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:14.362851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:14.379564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b24275f80e6401d8bb82452ef943cce', 'request_id': 'req-ed6145fd-ffaf-4916-8b26-be014abfe872'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.385103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b24275f80e6401d8bb82452ef943cce', 'request_id': 'req-ed6145fd-ffaf-4916-8b26-be014abfe872'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.391806 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b24275f80e6401d8bb82452ef943cce', 'request_id': 'req-ed6145fd-ffaf-4916-8b26-be014abfe872'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.469627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] The token cache is being invalidate because project 2b24275f80e6401d8bb82452ef943cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:14.469971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.470632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ed6145fd-ffaf-4916-8b26-be014abfe872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.472456 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1407/2782] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:14 2022] DELETE /identity/v3/projects/2b24275f80e6401d8bb82452ef943cce => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:14.478583 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b0490-0cf4-4944-b170-b80722aaa5f2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:14.479449 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b0490-0cf4-4944-b170-b80722aaa5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:14.479785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b0490-0cf4-4944-b170-b80722aaa5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:14.504936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d92b0490-0cf4-4944-b170-b80722aaa5f2 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:14.506461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d92b0490-0cf4-4944-b170-b80722aaa5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:14.520746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:14.587596 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1376/2783] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:14.590968 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13310dff-7308-404d-b647-7ddec22c840c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:14.591444 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13310dff-7308-404d-b647-7ddec22c840c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:14.591905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13310dff-7308-404d-b647-7ddec22c840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:14.614260 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-13310dff-7308-404d-b647-7ddec22c840c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:14.615817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-13310dff-7308-404d-b647-7ddec22c840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:14.629238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1408/2784] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:14.633741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b0490-0cf4-4944-b170-b80722aaa5f2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:14.643680 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b0490-0cf4-4944-b170-b80722aaa5f2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:14.648229 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:14.648823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:14.649096 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:14.649360 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:14.650127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:14.650423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:14.652791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:14.664748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1377/2785] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:11:14.669977 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13310dff-7308-404d-b647-7ddec22c840c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:14.679184 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13310dff-7308-404d-b647-7ddec22c840c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:14.684252 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202f0e6-693c-472b-98f5-f1a9912f8392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:14.684845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202f0e6-693c-472b-98f5-f1a9912f8392 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:14.685117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202f0e6-693c-472b-98f5-f1a9912f8392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:14.688327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202f0e6-693c-472b-98f5-f1a9912f8392 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:14.688327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202f0e6-693c-472b-98f5-f1a9912f8392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:14.688327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202f0e6-693c-472b-98f5-f1a9912f8392 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:14.691095 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:14.693136 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:14.709061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b537e-52f5-4658-8a43-ab95cd0fb1fc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:14.717058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:14.718379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:14.718746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:14.719064 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] PATH_INFO: `/v3/projects/e59091d3695c4e18a5a62ac13d3aa383` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:14.720166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59091d3695c4e18a5a62ac13d3aa383)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:14.722129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:14.871172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1409/2786] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:14 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:14.872205 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202f0e6-693c-472b-98f5-f1a9912f8392 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:14.878203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59091d3695c4e18a5a62ac13d3aa383', 'request_id': 'req-c3fa9716-d210-40c4-91e2-ca71d1689320'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.883736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59091d3695c4e18a5a62ac13d3aa383', 'request_id': 'req-c3fa9716-d210-40c4-91e2-ca71d1689320'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.892592 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59091d3695c4e18a5a62ac13d3aa383', 'request_id': 'req-c3fa9716-d210-40c4-91e2-ca71d1689320'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.934018 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202f0e6-693c-472b-98f5-f1a9912f8392 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:14.938653 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3f5b6-ac6d-4ebf-a05f-1481d5ec5834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:14.939246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3f5b6-ac6d-4ebf-a05f-1481d5ec5834 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:14.939520 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3f5b6-ac6d-4ebf-a05f-1481d5ec5834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:14.939789 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3f5b6-ac6d-4ebf-a05f-1481d5ec5834 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:14.940405 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3f5b6-ac6d-4ebf-a05f-1481d5ec5834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:14.942330 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3f5b6-ac6d-4ebf-a05f-1481d5ec5834 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:14.968659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] The token cache is being invalidate because project e59091d3695c4e18a5a62ac13d3aa383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:14.968974 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.969632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c3fa9716-d210-40c4-91e2-ca71d1689320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:14.971175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1378/2787] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:14 2022] DELETE /identity/v3/projects/e59091d3695c4e18a5a62ac13d3aa383 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:14.975805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981caf7-05d1-4d8a-ba80-6e9c57ea06de None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:14.976062 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981caf7-05d1-4d8a-ba80-6e9c57ea06de None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:14.976328 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981caf7-05d1-4d8a-ba80-6e9c57ea06de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:14.996043 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d981caf7-05d1-4d8a-ba80-6e9c57ea06de None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:14.997222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d981caf7-05d1-4d8a-ba80-6e9c57ea06de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:15.005059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1379/2788] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:15.013689 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01890fcf-3ec0-42c9-888e-96d56104a0dc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.013969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01890fcf-3ec0-42c9-888e-96d56104a0dc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.014239 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01890fcf-3ec0-42c9-888e-96d56104a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.033658 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-01890fcf-3ec0-42c9-888e-96d56104a0dc None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:15.034826 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-01890fcf-3ec0-42c9-888e-96d56104a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:15.038257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1410/2789] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:14 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:15.039486 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3f5b6-ac6d-4ebf-a05f-1481d5ec5834 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.041121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f8b3f5b6-ac6d-4ebf-a05f-1481d5ec5834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:15.042819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1380/2790] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:15.046846 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01890fcf-3ec0-42c9-888e-96d56104a0dc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.053678 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3f5b6-ac6d-4ebf-a05f-1481d5ec5834 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.056119 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01890fcf-3ec0-42c9-888e-96d56104a0dc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.058715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a0027-3955-48c5-a9e3-1146bac5f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.059313 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a0027-3955-48c5-a9e3-1146bac5f57f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.059595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a0027-3955-48c5-a9e3-1146bac5f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.059873 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a0027-3955-48c5-a9e3-1146bac5f57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.060517 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a0027-3955-48c5-a9e3-1146bac5f57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.061075 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8720a-ba84-4973-9ef5-1545083e2464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.061731 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8720a-ba84-4973-9ef5-1545083e2464 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.062007 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8720a-ba84-4973-9ef5-1545083e2464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.062170 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a0027-3955-48c5-a9e3-1146bac5f57f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.062270 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8720a-ba84-4973-9ef5-1545083e2464 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.062902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8720a-ba84-4973-9ef5-1545083e2464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:15.063201 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8720a-ba84-4973-9ef5-1545083e2464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.064774 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8720a-ba84-4973-9ef5-1545083e2464 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.076005 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1411/2791] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:11:15.080165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1381/2792] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:11:15.080320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a0027-3955-48c5-a9e3-1146bac5f57f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.081161 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8720a-ba84-4973-9ef5-1545083e2464 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.086890 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a0027-3955-48c5-a9e3-1146bac5f57f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.091567 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8720a-ba84-4973-9ef5-1545083e2464 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.092627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e79728-aa0d-4556-affe-b6f8d3bb5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.093230 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e79728-aa0d-4556-affe-b6f8d3bb5279 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.093541 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e79728-aa0d-4556-affe-b6f8d3bb5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.093815 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e79728-aa0d-4556-affe-b6f8d3bb5279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.094450 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e79728-aa0d-4556-affe-b6f8d3bb5279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.096071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e79728-aa0d-4556-affe-b6f8d3bb5279 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.096189 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb780450-7811-4c14-aae1-ced843d7c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.096795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb780450-7811-4c14-aae1-ced843d7c4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.097196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb780450-7811-4c14-aae1-ced843d7c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.097520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb780450-7811-4c14-aae1-ced843d7c4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.098133 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb780450-7811-4c14-aae1-ced843d7c4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.100025 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb780450-7811-4c14-aae1-ced843d7c4d0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.106976 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1412/2793] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:11:15.111101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e79728-aa0d-4556-affe-b6f8d3bb5279 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.121672 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e79728-aa0d-4556-affe-b6f8d3bb5279 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.126420 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a7621-dd4d-4094-89da-5f58204e65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.127052 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a7621-dd4d-4094-89da-5f58204e65b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.127329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a7621-dd4d-4094-89da-5f58204e65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.127625 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a7621-dd4d-4094-89da-5f58204e65b5 admin admin] PATH_INFO: `/v3/projects/cdf20db8bc9349cab5860aca604b81f8/users/1fea22feab704a5eaae971d51c49562d/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.142971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a7621-dd4d-4094-89da-5f58204e65b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf20db8bc9349cab5860aca604b81f8, user_id=1fea22feab704a5eaae971d51c49562d, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.145717 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a7621-dd4d-4094-89da-5f58204e65b5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.191089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1382/2794] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:15 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:15.195065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb780450-7811-4c14-aae1-ced843d7c4d0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.212453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1413/2795] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:15 2022] PUT /identity/v3/projects/cdf20db8bc9349cab5860aca604b81f8/users/1fea22feab704a5eaae971d51c49562d/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:15.224285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309702-a376-40c0-b2d1-859ee68c24d0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.224505 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309702-a376-40c0-b2d1-859ee68c24d0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.224811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71309702-a376-40c0-b2d1-859ee68c24d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.239569 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:15.253954 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-71309702-a376-40c0-b2d1-859ee68c24d0 None None] MFA Rules not processed for user `1fea22feab704a5eaae971d51c49562d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:15.255231 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-71309702-a376-40c0-b2d1-859ee68c24d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:15.259709 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb780450-7811-4c14-aae1-ced843d7c4d0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.274750 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:15.321066 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a1e8f-7367-43ad-88db-d8de68d448a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.321929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a1e8f-7367-43ad-88db-d8de68d448a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.322208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a1e8f-7367-43ad-88db-d8de68d448a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.323426 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a1e8f-7367-43ad-88db-d8de68d448a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.324369 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a1e8f-7367-43ad-88db-d8de68d448a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.326544 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a1e8f-7367-43ad-88db-d8de68d448a7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.338474 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1414/2796] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:15.343139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71309702-a376-40c0-b2d1-859ee68c24d0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.353965 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71309702-a376-40c0-b2d1-859ee68c24d0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.359117 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa9018-e0ac-4298-8c6c-9161f2ef9495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.359726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9018-e0ac-4298-8c6c-9161f2ef9495 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.360004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9018-e0ac-4298-8c6c-9161f2ef9495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.360280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9018-e0ac-4298-8c6c-9161f2ef9495 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.360911 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa9018-e0ac-4298-8c6c-9161f2ef9495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.363000 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa9018-e0ac-4298-8c6c-9161f2ef9495 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.426585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1383/2797] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:15 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:15.430696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a1e8f-7367-43ad-88db-d8de68d448a7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.441553 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a1e8f-7367-43ad-88db-d8de68d448a7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.446208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fd904-ad6e-4281-81e7-14299791cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.446802 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd904-ad6e-4281-81e7-14299791cd7a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.447079 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd904-ad6e-4281-81e7-14299791cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.448285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd904-ad6e-4281-81e7-14299791cd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.448953 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fd904-ad6e-4281-81e7-14299791cd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.450563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fd904-ad6e-4281-81e7-14299791cd7a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.464329 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1384/2798] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:11:15.468166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fd904-ad6e-4281-81e7-14299791cd7a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.474130 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1415/2799] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:15 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:15.475470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa9018-e0ac-4298-8c6c-9161f2ef9495 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.478044 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fd904-ad6e-4281-81e7-14299791cd7a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.537064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa9018-e0ac-4298-8c6c-9161f2ef9495 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.537990 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f3b6-8f75-424c-bca1-153df7f66b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.569453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f3b6-8f75-424c-bca1-153df7f66b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.569453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f3b6-8f75-424c-bca1-153df7f66b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.569453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f3b6-8f75-424c-bca1-153df7f66b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.569453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7f3b6-8f75-424c-bca1-153df7f66b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.569453 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7f3b6-8f75-424c-bca1-153df7f66b7d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.569997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073338b4-2c7a-42fe-8986-c92576164fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.569997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073338b4-2c7a-42fe-8986-c92576164fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.569997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073338b4-2c7a-42fe-8986-c92576164fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.569997 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073338b4-2c7a-42fe-8986-c92576164fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.570361 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073338b4-2c7a-42fe-8986-c92576164fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.570361 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073338b4-2c7a-42fe-8986-c92576164fe3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.570529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1385/2800] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:11:15.572620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f3b6-8f75-424c-bca1-153df7f66b7d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.582667 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f3b6-8f75-424c-bca1-153df7f66b7d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.587386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483eee1-49bd-4193-9e48-875bb1af5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.588302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483eee1-49bd-4193-9e48-875bb1af5b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.588549 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483eee1-49bd-4193-9e48-875bb1af5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.592634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483eee1-49bd-4193-9e48-875bb1af5b9f admin admin] PATH_INFO: `/v3/projects/7ff63f2d0f564876be14f47172e3635f/users/dea524b5fb5844599d0ce1829287e67c/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.604153 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483eee1-49bd-4193-9e48-875bb1af5b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff63f2d0f564876be14f47172e3635f, user_id=dea524b5fb5844599d0ce1829287e67c, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.606935 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483eee1-49bd-4193-9e48-875bb1af5b9f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.687278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1416/2801] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:15 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:15.691113 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073338b4-2c7a-42fe-8986-c92576164fe3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.700999 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073338b4-2c7a-42fe-8986-c92576164fe3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.708085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fe21e-84a9-4b5e-8cd6-9c297d151b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.708710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fe21e-84a9-4b5e-8cd6-9c297d151b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.709020 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fe21e-84a9-4b5e-8cd6-9c297d151b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.709289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fe21e-84a9-4b5e-8cd6-9c297d151b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.709974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fe21e-84a9-4b5e-8cd6-9c297d151b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.710707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1386/2802] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:15 2022] PUT /identity/v3/projects/7ff63f2d0f564876be14f47172e3635f/users/dea524b5fb5844599d0ce1829287e67c/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:15.711689 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fe21e-84a9-4b5e-8cd6-9c297d151b84 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.721014 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226f9fd-f0bb-4a4d-9ee9-d1f50dbff08a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.721432 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226f9fd-f0bb-4a4d-9ee9-d1f50dbff08a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.721736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226f9fd-f0bb-4a4d-9ee9-d1f50dbff08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.722452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1417/2803] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:11:15.730250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fe21e-84a9-4b5e-8cd6-9c297d151b84 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.736706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fe21e-84a9-4b5e-8cd6-9c297d151b84 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.752844 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5226f9fd-f0bb-4a4d-9ee9-d1f50dbff08a None None] MFA Rules not processed for user `dea524b5fb5844599d0ce1829287e67c`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:15.754214 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5226f9fd-f0bb-4a4d-9ee9-d1f50dbff08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:15.780755 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:15.794902 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9e5e0-adbd-45a5-952f-4acd5fd06ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.795590 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e5e0-adbd-45a5-952f-4acd5fd06ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.795862 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e5e0-adbd-45a5-952f-4acd5fd06ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.796136 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9e5e0-adbd-45a5-952f-4acd5fd06ee3 admin admin] PATH_INFO: `/v3/projects/3a3b2a6c2e614f5ea673e5347e9ead55/users/8c8800927dd84fc8861fc185f300e7b4/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.811129 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9e5e0-adbd-45a5-952f-4acd5fd06ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3b2a6c2e614f5ea673e5347e9ead55, user_id=8c8800927dd84fc8861fc185f300e7b4, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.813779 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9e5e0-adbd-45a5-952f-4acd5fd06ee3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.820123 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1387/2804] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:15.824754 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226f9fd-f0bb-4a4d-9ee9-d1f50dbff08a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.835286 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226f9fd-f0bb-4a4d-9ee9-d1f50dbff08a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:15.840114 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215321f8-6120-455c-a6c8-e52eb39bdf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:15.843451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215321f8-6120-455c-a6c8-e52eb39bdf41 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:15.843451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215321f8-6120-455c-a6c8-e52eb39bdf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:15.843451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215321f8-6120-455c-a6c8-e52eb39bdf41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:15.843451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215321f8-6120-455c-a6c8-e52eb39bdf41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:15.844364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215321f8-6120-455c-a6c8-e52eb39bdf41 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:15.913047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:15.918289 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1418/2805] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:15 2022] PUT /identity/v3/projects/3a3b2a6c2e614f5ea673e5347e9ead55/users/8c8800927dd84fc8861fc185f300e7b4/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:15.922071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9e5e0-adbd-45a5-952f-4acd5fd06ee3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.941708 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1388/2806] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:15 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:15.948654 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215321f8-6120-455c-a6c8-e52eb39bdf41 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:15.986834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9e5e0-adbd-45a5-952f-4acd5fd06ee3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.015262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215321f8-6120-455c-a6c8-e52eb39bdf41 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.019862 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77839b2-2a32-4de6-8e26-d7729280912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.020463 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77839b2-2a32-4de6-8e26-d7729280912b admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.020740 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77839b2-2a32-4de6-8e26-d7729280912b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.021013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77839b2-2a32-4de6-8e26-d7729280912b admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.021665 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77839b2-2a32-4de6-8e26-d7729280912b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.023563 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77839b2-2a32-4de6-8e26-d7729280912b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.044503 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2dda2-e1df-439d-985b-7a2241ca89f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.050040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2dda2-e1df-439d-985b-7a2241ca89f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.050040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2dda2-e1df-439d-985b-7a2241ca89f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.050040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2dda2-e1df-439d-985b-7a2241ca89f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.050040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2dda2-e1df-439d-985b-7a2241ca89f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.050040 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2dda2-e1df-439d-985b-7a2241ca89f9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.057382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1419/2807] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:11:16.061341 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2dda2-e1df-439d-985b-7a2241ca89f9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.070530 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2dda2-e1df-439d-985b-7a2241ca89f9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.075173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504c547-92a8-43f4-b816-aace4e9bdb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.075769 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c547-92a8-43f4-b816-aace4e9bdb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.076043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c547-92a8-43f4-b816-aace4e9bdb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.076311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c547-92a8-43f4-b816-aace4e9bdb88 admin admin] PATH_INFO: `/v3/projects/3a3b2a6c2e614f5ea673e5347e9ead55/users/8c8800927dd84fc8861fc185f300e7b4/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.078185 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c547-92a8-43f4-b816-aace4e9bdb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3b2a6c2e614f5ea673e5347e9ead55, user_id=8c8800927dd84fc8861fc185f300e7b4, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.080764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c547-92a8-43f4-b816-aace4e9bdb88 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.091109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1420/2808] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:16 2022] PUT /identity/v3/projects/3a3b2a6c2e614f5ea673e5347e9ead55/users/8c8800927dd84fc8861fc185f300e7b4/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:16.102111 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d167-8b54-425c-9ef4-e9d01f0d0e68 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.102490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d167-8b54-425c-9ef4-e9d01f0d0e68 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.102748 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d167-8b54-425c-9ef4-e9d01f0d0e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.113733 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1389/2809] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:15 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:16.114711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77839b2-2a32-4de6-8e26-d7729280912b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.124944 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77839b2-2a32-4de6-8e26-d7729280912b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.133904 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d240d167-8b54-425c-9ef4-e9d01f0d0e68 None None] MFA Rules not processed for user `8c8800927dd84fc8861fc185f300e7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:16.135173 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d240d167-8b54-425c-9ef4-e9d01f0d0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:16.181582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5444fd-683a-43f8-8478-16f52f62348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.182445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5444fd-683a-43f8-8478-16f52f62348d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.182717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5444fd-683a-43f8-8478-16f52f62348d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.182992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5444fd-683a-43f8-8478-16f52f62348d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.183626 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5444fd-683a-43f8-8478-16f52f62348d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.185203 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5444fd-683a-43f8-8478-16f52f62348d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.197735 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1390/2810] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:11:16.198816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5444fd-683a-43f8-8478-16f52f62348d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.205039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1421/2811] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:16.208904 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5444fd-683a-43f8-8478-16f52f62348d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.212686 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18976e-de2e-4513-ab2c-f2ecebe4fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.213954 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18976e-de2e-4513-ab2c-f2ecebe4fefb admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.214230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18976e-de2e-4513-ab2c-f2ecebe4fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.214494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18976e-de2e-4513-ab2c-f2ecebe4fefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.215128 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18976e-de2e-4513-ab2c-f2ecebe4fefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.216865 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240d167-8b54-425c-9ef4-e9d01f0d0e68 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.217009 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18976e-de2e-4513-ab2c-f2ecebe4fefb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.218329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d240d167-8b54-425c-9ef4-e9d01f0d0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:16.227745 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1391/2812] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:11:16.232518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18976e-de2e-4513-ab2c-f2ecebe4fefb admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.240851 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:16.242402 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18976e-de2e-4513-ab2c-f2ecebe4fefb admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.247035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae9d0a-e9c0-4d15-af6d-cb725191a4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.247664 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae9d0a-e9c0-4d15-af6d-cb725191a4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.247937 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae9d0a-e9c0-4d15-af6d-cb725191a4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.248200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae9d0a-e9c0-4d15-af6d-cb725191a4f8 admin admin] PATH_INFO: `/v3/projects/21c0a5f77a154b7bbb7f7325c45641d3/users/8b3ba9caba6d411dbf7e36523fcf5337/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.262915 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae9d0a-e9c0-4d15-af6d-cb725191a4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c0a5f77a154b7bbb7f7325c45641d3, user_id=8b3ba9caba6d411dbf7e36523fcf5337, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.265566 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae9d0a-e9c0-4d15-af6d-cb725191a4f8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.268520 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:16.303424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240d167-8b54-425c-9ef4-e9d01f0d0e68 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.307150 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99539d2b-5edf-47b1-90bf-d9ce4b653945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.307756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99539d2b-5edf-47b1-90bf-d9ce4b653945 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.308045 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99539d2b-5edf-47b1-90bf-d9ce4b653945 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.308310 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99539d2b-5edf-47b1-90bf-d9ce4b653945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.323779 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1392/2813] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:16 2022] PUT /identity/v3/projects/21c0a5f77a154b7bbb7f7325c45641d3/users/8b3ba9caba6d411dbf7e36523fcf5337/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:16.372958 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99539d2b-5edf-47b1-90bf-d9ce4b653945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.374499 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99539d2b-5edf-47b1-90bf-d9ce4b653945 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.384443 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1422/2814] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:11:16.393374 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25335114-929e-480a-9cea-7e65670be5ee None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.393794 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25335114-929e-480a-9cea-7e65670be5ee None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.394143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25335114-929e-480a-9cea-7e65670be5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.422243 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-25335114-929e-480a-9cea-7e65670be5ee None None] MFA Rules not processed for user `8b3ba9caba6d411dbf7e36523fcf5337`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:16.424288 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-25335114-929e-480a-9cea-7e65670be5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:16.498358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1393/2815] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:16.502845 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99539d2b-5edf-47b1-90bf-d9ce4b653945 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.515745 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99539d2b-5edf-47b1-90bf-d9ce4b653945 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.574850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081aa881-9469-46b4-b050-5ba01269c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.575602 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aa881-9469-46b4-b050-5ba01269c958 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.575882 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aa881-9469-46b4-b050-5ba01269c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.576149 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aa881-9469-46b4-b050-5ba01269c958 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.576771 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081aa881-9469-46b4-b050-5ba01269c958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.578682 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081aa881-9469-46b4-b050-5ba01269c958 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.685172 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1423/2816] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:16 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:16.689098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25335114-929e-480a-9cea-7e65670be5ee None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.700564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25335114-929e-480a-9cea-7e65670be5ee None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.762325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04853799-6261-4cea-a1ca-cfb15b7369b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.762325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04853799-6261-4cea-a1ca-cfb15b7369b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.762659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04853799-6261-4cea-a1ca-cfb15b7369b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.762659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04853799-6261-4cea-a1ca-cfb15b7369b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.763269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04853799-6261-4cea-a1ca-cfb15b7369b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.765220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04853799-6261-4cea-a1ca-cfb15b7369b3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.872455 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1394/2817] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:16 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:16.876615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081aa881-9469-46b4-b050-5ba01269c958 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.887824 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081aa881-9469-46b4-b050-5ba01269c958 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.895054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8394d-406e-4cef-b218-050cfa765ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.896127 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8394d-406e-4cef-b218-050cfa765ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.896674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8394d-406e-4cef-b218-050cfa765ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.897242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8394d-406e-4cef-b218-050cfa765ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.898453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8394d-406e-4cef-b218-050cfa765ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.901991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8394d-406e-4cef-b218-050cfa765ce4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.914762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1424/2818] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:16.928706 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04853799-6261-4cea-a1ca-cfb15b7369b3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.939159 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04853799-6261-4cea-a1ca-cfb15b7369b3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.943736 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4a7b6-83f2-41b9-8042-108e53d2042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.944362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4a7b6-83f2-41b9-8042-108e53d2042c admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.944640 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4a7b6-83f2-41b9-8042-108e53d2042c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.944917 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4a7b6-83f2-41b9-8042-108e53d2042c admin admin] PATH_INFO: `/v3/projects/30780220ffa24183a354390a041a2b8d/users/e21d1d083f304c9a94c7505f010e7142/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.960115 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4a7b6-83f2-41b9-8042-108e53d2042c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30780220ffa24183a354390a041a2b8d, user_id=e21d1d083f304c9a94c7505f010e7142, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.963382 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4a7b6-83f2-41b9-8042-108e53d2042c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:17.041425 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1395/2819] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:16 2022] PUT /identity/v3/projects/30780220ffa24183a354390a041a2b8d/users/e21d1d083f304c9a94c7505f010e7142/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:17.045201 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8394d-406e-4cef-b218-050cfa765ce4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:17.056081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8394d-406e-4cef-b218-050cfa765ce4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:17.086071 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:17.128163 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2a33a-878c-4752-be98-5ed4c8e5e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:17.128801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2a33a-878c-4752-be98-5ed4c8e5e826 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:17.129075 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2a33a-878c-4752-be98-5ed4c8e5e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:17.129367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2a33a-878c-4752-be98-5ed4c8e5e826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:17.130047 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2a33a-878c-4752-be98-5ed4c8e5e826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:17.131663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2a33a-878c-4752-be98-5ed4c8e5e826 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:17.142548 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1425/2820] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:17.146688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4a7b6-83f2-41b9-8042-108e53d2042c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:17.157850 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4a7b6-83f2-41b9-8042-108e53d2042c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:17.162535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a921b0-71f4-48f8-8c7c-d18e69473599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:17.163193 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a921b0-71f4-48f8-8c7c-d18e69473599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:17.163468 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a921b0-71f4-48f8-8c7c-d18e69473599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:17.163739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a921b0-71f4-48f8-8c7c-d18e69473599 admin admin] PATH_INFO: `/v3/projects/30780220ffa24183a354390a041a2b8d/users/e21d1d083f304c9a94c7505f010e7142/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:17.172578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a921b0-71f4-48f8-8c7c-d18e69473599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30780220ffa24183a354390a041a2b8d, user_id=e21d1d083f304c9a94c7505f010e7142, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:17.172578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a921b0-71f4-48f8-8c7c-d18e69473599 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:17.179130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1396/2821] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:17 2022] PUT /identity/v3/projects/30780220ffa24183a354390a041a2b8d/users/e21d1d083f304c9a94c7505f010e7142/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:17.189601 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07091846-ac61-4320-9e79-ac03b1d6f76c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:17.190101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07091846-ac61-4320-9e79-ac03b1d6f76c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:17.195663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07091846-ac61-4320-9e79-ac03b1d6f76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:17.220132 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-07091846-ac61-4320-9e79-ac03b1d6f76c None None] MFA Rules not processed for user `e21d1d083f304c9a94c7505f010e7142`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:17.221351 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-07091846-ac61-4320-9e79-ac03b1d6f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:17.291461 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1426/2822] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:17.303015 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a921b0-71f4-48f8-8c7c-d18e69473599 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:17.345919 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:17.359551 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a921b0-71f4-48f8-8c7c-d18e69473599 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:17.364109 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd01e4f-508d-4f08-9a40-e119cb0f593e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:17.365205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd01e4f-508d-4f08-9a40-e119cb0f593e service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:17.365205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd01e4f-508d-4f08-9a40-e119cb0f593e service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:17.365205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd01e4f-508d-4f08-9a40-e119cb0f593e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:17.426234 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd01e4f-508d-4f08-9a40-e119cb0f593e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:17.427739 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd01e4f-508d-4f08-9a40-e119cb0f593e service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:17.437936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1397/2823] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:19.492675 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07091846-ac61-4320-9e79-ac03b1d6f76c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:19.493151 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd01e4f-508d-4f08-9a40-e119cb0f593e service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:19.494964 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-07091846-ac61-4320-9e79-ac03b1d6f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:19.507012 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07091846-ac61-4320-9e79-ac03b1d6f76c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:19.510943 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff103c-0e51-47bf-bb48-5172dc5639d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:19.511539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff103c-0e51-47bf-bb48-5172dc5639d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:19.511906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff103c-0e51-47bf-bb48-5172dc5639d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:19.514780 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff103c-0e51-47bf-bb48-5172dc5639d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:19.559269 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd01e4f-508d-4f08-9a40-e119cb0f593e service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:19.563761 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:19.564377 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:19.564648 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:19.564911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] PATH_INFO: `/v3/users/1fea22feab704a5eaae971d51c49562d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:19.566041 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fea22feab704a5eaae971d51c49562d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:19.568547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:19.569605 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff103c-0e51-47bf-bb48-5172dc5639d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:19.571043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff103c-0e51-47bf-bb48-5172dc5639d7 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:19.580294 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1427/2824] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:19.762263 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fea22feab704a5eaae971d51c49562d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:19.768867 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fea22feab704a5eaae971d51c49562d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:19.769545 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fea22feab704a5eaae971d51c49562d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:19.770144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fea22feab704a5eaae971d51c49562d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:19.854562 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fea22feab704a5eaae971d51c49562d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:19.872578 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1398/2825] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:19 2022] DELETE /identity/v3/users/1fea22feab704a5eaae971d51c49562d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:19.877322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820604-6bb4-44c7-a8ad-5cd71b75cd1d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:19.880583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820604-6bb4-44c7-a8ad-5cd71b75cd1d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:19.880583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820604-6bb4-44c7-a8ad-5cd71b75cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:19.896808 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-fd820604-6bb4-44c7-a8ad-5cd71b75cd1d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:19.898228 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fd820604-6bb4-44c7-a8ad-5cd71b75cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:19.939303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:19.957391 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1428/2826] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:19.968016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:19.969436 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:19.983448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:20.030506 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffb644-6a28-452a-bd86-8990373ac3df admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:20.034325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f7058-6e3f-4968-b416-2717004dec70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:20.035054 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f7058-6e3f-4968-b416-2717004dec70 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:20.035422 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f7058-6e3f-4968-b416-2717004dec70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:20.035691 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f7058-6e3f-4968-b416-2717004dec70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:20.047752 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f7058-6e3f-4968-b416-2717004dec70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:20.049366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f7058-6e3f-4968-b416-2717004dec70 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:20.061378 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1399/2827] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:20.507482 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd820604-6bb4-44c7-a8ad-5cd71b75cd1d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:20.508971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fd820604-6bb4-44c7-a8ad-5cd71b75cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:20.524401 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd820604-6bb4-44c7-a8ad-5cd71b75cd1d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:20.530585 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:20.531153 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:20.531427 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:20.531696 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] PATH_INFO: `/v3/projects/cdf20db8bc9349cab5860aca604b81f8` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:20.533259 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf20db8bc9349cab5860aca604b81f8)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:20.539932 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:20.638849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf20db8bc9349cab5860aca604b81f8', 'request_id': 'req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:20.644255 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf20db8bc9349cab5860aca604b81f8', 'request_id': 'req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:20.650713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf20db8bc9349cab5860aca604b81f8', 'request_id': 'req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:20.743896 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] The token cache is being invalidate because project cdf20db8bc9349cab5860aca604b81f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:20.751008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:20.751008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:20.751008 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1429/2828] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:20 2022] DELETE /identity/v3/projects/cdf20db8bc9349cab5860aca604b81f8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:20.751349 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f7058-6e3f-4968-b416-2717004dec70 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:20.761916 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f7058-6e3f-4968-b416-2717004dec70 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:20.821413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:20.822765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:20.822765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:20.822980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] PATH_INFO: `/v3/users/8c8800927dd84fc8861fc185f300e7b4` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:20.823978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8800927dd84fc8861fc185f300e7b4)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:20.825911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:21.067707 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8800927dd84fc8861fc185f300e7b4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.076656 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8800927dd84fc8861fc185f300e7b4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.077276 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8800927dd84fc8861fc185f300e7b4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.077946 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8800927dd84fc8861fc185f300e7b4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.179677 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8800927dd84fc8861fc185f300e7b4'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.199326 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1400/2829] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:20 2022] DELETE /identity/v3/users/8c8800927dd84fc8861fc185f300e7b4 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:21.214660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:21.216109 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:21.288644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe2d23-d4f7-4a93-99d3-69cc53c0afef admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:21.346957 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786a8f1-e3e7-41ee-aa92-255c103a36e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:21.347488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a8f1-e3e7-41ee-aa92-255c103a36e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:21.347765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a8f1-e3e7-41ee-aa92-255c103a36e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:21.348058 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a8f1-e3e7-41ee-aa92-255c103a36e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:21.349820 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1786a8f1-e3e7-41ee-aa92-255c103a36e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:21.394991 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:21.421140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786a8f1-e3e7-41ee-aa92-255c103a36e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:21.426298 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786a8f1-e3e7-41ee-aa92-255c103a36e8 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:21.439279 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1430/2830] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:21.646051 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:21.647732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:21.700116 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:21.734475 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e074dbd-899f-4800-93d6-b01880aac7de admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:21.739284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:21.739918 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:21.740471 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:21.740741 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] PATH_INFO: `/v3/projects/3a3b2a6c2e614f5ea673e5347e9ead55` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:21.741900 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3b2a6c2e614f5ea673e5347e9ead55)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:21.743791 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:21.860960 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3b2a6c2e614f5ea673e5347e9ead55', 'request_id': 'req-ff070362-6e19-4776-9605-eb933051e416'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.870165 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3b2a6c2e614f5ea673e5347e9ead55', 'request_id': 'req-ff070362-6e19-4776-9605-eb933051e416'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.877278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3b2a6c2e614f5ea673e5347e9ead55', 'request_id': 'req-ff070362-6e19-4776-9605-eb933051e416'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.991129 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] The token cache is being invalidate because project 3a3b2a6c2e614f5ea673e5347e9ead55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:21.991631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.992273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ff070362-6e19-4776-9605-eb933051e416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:21.993868 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1401/2831] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:21 2022] DELETE /identity/v3/projects/3a3b2a6c2e614f5ea673e5347e9ead55 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:21.998996 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60474e8-949c-4275-8248-b500191f44fd None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:21.999551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60474e8-949c-4275-8248-b500191f44fd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:21.999658 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60474e8-949c-4275-8248-b500191f44fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.020524 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c60474e8-949c-4275-8248-b500191f44fd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:22.022025 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c60474e8-949c-4275-8248-b500191f44fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:22.096328 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1431/2832] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:22.163936 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dacd5f-4c36-49d1-ad10-8802ccf47996 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:22.164220 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dacd5f-4c36-49d1-ad10-8802ccf47996 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:22.164529 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dacd5f-4c36-49d1-ad10-8802ccf47996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.186144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-72dacd5f-4c36-49d1-ad10-8802ccf47996 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:22.194042 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-72dacd5f-4c36-49d1-ad10-8802ccf47996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:22.199895 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1402/2833] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:22.204372 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60474e8-949c-4275-8248-b500191f44fd None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:22.215309 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60474e8-949c-4275-8248-b500191f44fd None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:22.219906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1293e6-72ec-4227-8f05-72ca56e3ac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:22.222973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1293e6-72ec-4227-8f05-72ca56e3ac11 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:22.222973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1293e6-72ec-4227-8f05-72ca56e3ac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:22.222973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1293e6-72ec-4227-8f05-72ca56e3ac11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.222973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1293e6-72ec-4227-8f05-72ca56e3ac11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:22.222973 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1293e6-72ec-4227-8f05-72ca56e3ac11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:22.223610 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1293e6-72ec-4227-8f05-72ca56e3ac11 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:22.236553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1432/2834] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:11:22.241321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dacd5f-4c36-49d1-ad10-8802ccf47996 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:22.252445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dacd5f-4c36-49d1-ad10-8802ccf47996 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:22.257450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd21f3-a995-44c9-92ca-44681ddcdaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:22.258087 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd21f3-a995-44c9-92ca-44681ddcdaaf admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:22.258364 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd21f3-a995-44c9-92ca-44681ddcdaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:22.258631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd21f3-a995-44c9-92ca-44681ddcdaaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.259257 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd21f3-a995-44c9-92ca-44681ddcdaaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:22.261712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd21f3-a995-44c9-92ca-44681ddcdaaf admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:22.353280 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1403/2835] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:22 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:22.357693 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1293e6-72ec-4227-8f05-72ca56e3ac11 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:22.368251 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1293e6-72ec-4227-8f05-72ca56e3ac11 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:22.424097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118ff4-b089-4a68-bc34-37ba272504d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:22.424683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118ff4-b089-4a68-bc34-37ba272504d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:22.424983 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118ff4-b089-4a68-bc34-37ba272504d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:22.425246 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb118ff4-b089-4a68-bc34-37ba272504d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.425905 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118ff4-b089-4a68-bc34-37ba272504d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:22.427801 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb118ff4-b089-4a68-bc34-37ba272504d0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:22.511574 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1433/2836] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:22 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:22.515599 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd21f3-a995-44c9-92ca-44681ddcdaaf admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:22.526729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd21f3-a995-44c9-92ca-44681ddcdaaf admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:22.531387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c878cfc-7487-42fb-9d26-02abe5d2c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:22.531978 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c878cfc-7487-42fb-9d26-02abe5d2c9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:22.532255 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c878cfc-7487-42fb-9d26-02abe5d2c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:22.532526 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c878cfc-7487-42fb-9d26-02abe5d2c9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.533164 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c878cfc-7487-42fb-9d26-02abe5d2c9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:22.534784 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c878cfc-7487-42fb-9d26-02abe5d2c9f2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:22.544600 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1404/2837] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:22.548823 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118ff4-b089-4a68-bc34-37ba272504d0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:22.558850 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb118ff4-b089-4a68-bc34-37ba272504d0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:22.563327 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5109540-dab1-43a5-8b18-18014e4a4976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:22.563909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5109540-dab1-43a5-8b18-18014e4a4976 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:22.564206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5109540-dab1-43a5-8b18-18014e4a4976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:22.564472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5109540-dab1-43a5-8b18-18014e4a4976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.565101 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5109540-dab1-43a5-8b18-18014e4a4976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:22.566698 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5109540-dab1-43a5-8b18-18014e4a4976 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:22.577733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1434/2838] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:22.584871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c878cfc-7487-42fb-9d26-02abe5d2c9f2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:22.596135 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c878cfc-7487-42fb-9d26-02abe5d2c9f2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:22.600897 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880a4a9-7cde-4c62-8c54-a2ff1cb6f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:22.601605 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a4a9-7cde-4c62-8c54-a2ff1cb6f56b admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:22.601880 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a4a9-7cde-4c62-8c54-a2ff1cb6f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:22.602148 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a4a9-7cde-4c62-8c54-a2ff1cb6f56b admin admin] PATH_INFO: `/v3/projects/9d36988faf134867a226b854e0733ad2/users/9113ed68f1e44147ac49a7ef3a8e1fbd/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.617141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880a4a9-7cde-4c62-8c54-a2ff1cb6f56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d36988faf134867a226b854e0733ad2, user_id=9113ed68f1e44147ac49a7ef3a8e1fbd, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:22.620423 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880a4a9-7cde-4c62-8c54-a2ff1cb6f56b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:22.700845 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1405/2839] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:22 2022] PUT /identity/v3/projects/9d36988faf134867a226b854e0733ad2/users/9113ed68f1e44147ac49a7ef3a8e1fbd/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:22.711268 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b0540-0df1-4c28-96d0-b4484af99b69 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:22.711547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b0540-0df1-4c28-96d0-b4484af99b69 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:22.711817 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b0540-0df1-4c28-96d0-b4484af99b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.747569 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b32b0540-0df1-4c28-96d0-b4484af99b69 None None] MFA Rules not processed for user `9113ed68f1e44147ac49a7ef3a8e1fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:22.748989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b32b0540-0df1-4c28-96d0-b4484af99b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:22.783481 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:22.820564 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1435/2840] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:22.833514 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880a4a9-7cde-4c62-8c54-a2ff1cb6f56b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:22.835980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e880a4a9-7cde-4c62-8c54-a2ff1cb6f56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:22.894451 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880a4a9-7cde-4c62-8c54-a2ff1cb6f56b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:22.898127 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb269b-1fce-4102-81db-3afca7e30ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:22.898693 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb269b-1fce-4102-81db-3afca7e30ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:22.898968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb269b-1fce-4102-81db-3afca7e30ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:22.899237 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb269b-1fce-4102-81db-3afca7e30ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:22.907992 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb269b-1fce-4102-81db-3afca7e30ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:22.909414 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb269b-1fce-4102-81db-3afca7e30ca3 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:22.918668 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1406/2841] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:26.060498 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b0540-0df1-4c28-96d0-b4484af99b69 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:26.061987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b32b0540-0df1-4c28-96d0-b4484af99b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:26.128036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b0540-0df1-4c28-96d0-b4484af99b69 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:26.132437 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:26.133081 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:26.133357 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:26.133666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] PATH_INFO: `/v3/users/dea524b5fb5844599d0ce1829287e67c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:26.134989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea524b5fb5844599d0ce1829287e67c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:26.136922 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:26.415160 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea524b5fb5844599d0ce1829287e67c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:26.416579 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea524b5fb5844599d0ce1829287e67c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:26.417343 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea524b5fb5844599d0ce1829287e67c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:26.531663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea524b5fb5844599d0ce1829287e67c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:26.544960 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea524b5fb5844599d0ce1829287e67c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:26.560572 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1436/2842] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:26 2022] DELETE /identity/v3/users/dea524b5fb5844599d0ce1829287e67c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:26.562340 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c94e7-e62f-48df-ad1c-bedf79f4b237 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:26.562795 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c94e7-e62f-48df-ad1c-bedf79f4b237 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:26.563035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c94e7-e62f-48df-ad1c-bedf79f4b237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:26.571625 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:26.582949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-380c94e7-e62f-48df-ad1c-bedf79f4b237 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:26.584130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-380c94e7-e62f-48df-ad1c-bedf79f4b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:26.641888 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1407/2843] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:26.652691 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:26.654403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:26.720736 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:26.724616 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373f624-3068-4b43-94b5-e767d750e345 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:26.728861 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a2c0e-7e06-49cf-9ba9-e4efaa694fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:26.729644 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a2c0e-7e06-49cf-9ba9-e4efaa694fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:26.729923 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a2c0e-7e06-49cf-9ba9-e4efaa694fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:26.730196 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a2c0e-7e06-49cf-9ba9-e4efaa694fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:26.740424 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a2c0e-7e06-49cf-9ba9-e4efaa694fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:26.757680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a2c0e-7e06-49cf-9ba9-e4efaa694fd8 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:26.757680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1437/2844] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:27.200572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c94e7-e62f-48df-ad1c-bedf79f4b237 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:27.200572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-380c94e7-e62f-48df-ad1c-bedf79f4b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:27.211372 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c94e7-e62f-48df-ad1c-bedf79f4b237 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:27.215872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:27.216498 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:27.216769 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:27.217035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] PATH_INFO: `/v3/projects/7ff63f2d0f564876be14f47172e3635f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:27.218302 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff63f2d0f564876be14f47172e3635f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:27.220637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:27.328816 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff63f2d0f564876be14f47172e3635f', 'request_id': 'req-4df55ad0-1e59-4410-992d-f6b37a02b789'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.334194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff63f2d0f564876be14f47172e3635f', 'request_id': 'req-4df55ad0-1e59-4410-992d-f6b37a02b789'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.340261 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff63f2d0f564876be14f47172e3635f', 'request_id': 'req-4df55ad0-1e59-4410-992d-f6b37a02b789'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.449358 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] The token cache is being invalidate because project 7ff63f2d0f564876be14f47172e3635f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:27.449593 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.450194 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.451675 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1408/2845] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:27 2022] DELETE /identity/v3/projects/7ff63f2d0f564876be14f47172e3635f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:27.455919 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a2c0e-7e06-49cf-9ba9-e4efaa694fd8 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:27.466145 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a2c0e-7e06-49cf-9ba9-e4efaa694fd8 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:27.522961 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:27.523615 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:27.523940 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:27.524214 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] PATH_INFO: `/v3/users/8b3ba9caba6d411dbf7e36523fcf5337` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:27.525742 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3ba9caba6d411dbf7e36523fcf5337)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:27.527800 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:27.725792 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3ba9caba6d411dbf7e36523fcf5337'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.726470 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3ba9caba6d411dbf7e36523fcf5337'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.727094 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3ba9caba6d411dbf7e36523fcf5337'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.817176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3ba9caba6d411dbf7e36523fcf5337'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.830291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3ba9caba6d411dbf7e36523fcf5337'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:27.843051 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1438/2846] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:27 2022] DELETE /identity/v3/users/8b3ba9caba6d411dbf7e36523fcf5337 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:28.253620 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:28.255089 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:28.268926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55ad0-1e59-4410-992d-f6b37a02b789 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:28.329717 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:28.330345 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:28.330615 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:28.330877 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] PATH_INFO: `/v3/projects/21c0a5f77a154b7bbb7f7325c45641d3` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:28.331975 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c0a5f77a154b7bbb7f7325c45641d3)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:28.333893 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:28.477245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:28.492628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c0a5f77a154b7bbb7f7325c45641d3', 'request_id': 'req-495ca7e7-9339-44a1-b428-3c202bd97d6c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:28.498053 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c0a5f77a154b7bbb7f7325c45641d3', 'request_id': 'req-495ca7e7-9339-44a1-b428-3c202bd97d6c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:28.504325 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c0a5f77a154b7bbb7f7325c45641d3', 'request_id': 'req-495ca7e7-9339-44a1-b428-3c202bd97d6c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:28.611547 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] The token cache is being invalidate because project 21c0a5f77a154b7bbb7f7325c45641d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:28.611836 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:28.612447 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:28.614003 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1409/2847] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:28 2022] DELETE /identity/v3/projects/21c0a5f77a154b7bbb7f7325c45641d3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:28.618471 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:28.621116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:28.633805 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536d2f7-85a4-47d2-b631-4b855b6f74f5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:28.691732 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:28.692356 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:28.692715 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:28.692904 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] PATH_INFO: `/v3/users/e21d1d083f304c9a94c7505f010e7142` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:28.694043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21d1d083f304c9a94c7505f010e7142)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:28.695939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:28.709376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:28.930253 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21d1d083f304c9a94c7505f010e7142'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:28.930929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21d1d083f304c9a94c7505f010e7142'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:28.931542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21d1d083f304c9a94c7505f010e7142'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:28.996648 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21d1d083f304c9a94c7505f010e7142'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:29.010713 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1618f3dc-fec2-46eb-b130-b195b80cccc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21d1d083f304c9a94c7505f010e7142'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:29.023870 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1439/2848] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:28 2022] DELETE /identity/v3/users/e21d1d083f304c9a94c7505f010e7142 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:29.438775 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:29.440259 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:29.453805 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca7e7-9339-44a1-b428-3c202bd97d6c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:29.513594 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:29.514230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:29.514509 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:29.514784 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] PATH_INFO: `/v3/projects/30780220ffa24183a354390a041a2b8d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:29.515997 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30780220ffa24183a354390a041a2b8d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:29.517931 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:29.692742 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30780220ffa24183a354390a041a2b8d', 'request_id': 'req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:29.698568 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30780220ffa24183a354390a041a2b8d', 'request_id': 'req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:29.704911 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30780220ffa24183a354390a041a2b8d', 'request_id': 'req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:29.788445 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] The token cache is being invalidate because project 30780220ffa24183a354390a041a2b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:29.788785 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:29.789357 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ce681f5-4726-43a3-8f0f-b21f2dc690b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:29.790869 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1410/2849] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:29 2022] DELETE /identity/v3/projects/30780220ffa24183a354390a041a2b8d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:29.795670 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15384e0-1333-4922-b367-dee449c084b5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:29.796159 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15384e0-1333-4922-b367-dee449c084b5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:29.796628 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15384e0-1333-4922-b367-dee449c084b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:29.816707 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d15384e0-1333-4922-b367-dee449c084b5 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:29.817937 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d15384e0-1333-4922-b367-dee449c084b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:29.876901 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1440/2850] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:29.886723 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ce207-530b-49c0-993d-a36504c82f8a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:29.886998 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ce207-530b-49c0-993d-a36504c82f8a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:29.887264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ce207-530b-49c0-993d-a36504c82f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:29.907052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3e9ce207-530b-49c0-993d-a36504c82f8a None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:29.911250 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3e9ce207-530b-49c0-993d-a36504c82f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:29.916125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1411/2851] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:29.920586 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15384e0-1333-4922-b367-dee449c084b5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:29.930783 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15384e0-1333-4922-b367-dee449c084b5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:29.935756 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e80b7-bff4-4b8b-8429-8129d544e694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:29.936345 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e80b7-bff4-4b8b-8429-8129d544e694 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:29.936620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e80b7-bff4-4b8b-8429-8129d544e694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:29.936886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e80b7-bff4-4b8b-8429-8129d544e694 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:29.937546 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e80b7-bff4-4b8b-8429-8129d544e694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:29.937846 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e80b7-bff4-4b8b-8429-8129d544e694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:29.939421 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e80b7-bff4-4b8b-8429-8129d544e694 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:29.951397 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1441/2852] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:11:29.955564 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ce207-530b-49c0-993d-a36504c82f8a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:29.965685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ce207-530b-49c0-993d-a36504c82f8a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:29.970342 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e9cf6-e50a-4f75-8d96-ab06835177b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:29.970930 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e9cf6-e50a-4f75-8d96-ab06835177b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:29.971205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e9cf6-e50a-4f75-8d96-ab06835177b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:29.971472 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e9cf6-e50a-4f75-8d96-ab06835177b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:29.972084 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e9cf6-e50a-4f75-8d96-ab06835177b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:29.974016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e9cf6-e50a-4f75-8d96-ab06835177b4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:30.071585 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1412/2853] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:29 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:30.076220 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e80b7-bff4-4b8b-8429-8129d544e694 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:30.086086 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e80b7-bff4-4b8b-8429-8129d544e694 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:30.141547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7767a6-023b-4384-9b75-cd1396218f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:30.142139 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7767a6-023b-4384-9b75-cd1396218f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:30.142417 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7767a6-023b-4384-9b75-cd1396218f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:30.142684 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7767a6-023b-4384-9b75-cd1396218f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:30.143320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7767a6-023b-4384-9b75-cd1396218f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:30.145183 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7767a6-023b-4384-9b75-cd1396218f8c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:30.232436 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1442/2854] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:30 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:30.234132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e9cf6-e50a-4f75-8d96-ab06835177b4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:30.245354 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e9cf6-e50a-4f75-8d96-ab06835177b4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:30.250470 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcb748-75dc-4a88-b617-410a27e9580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:30.251141 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcb748-75dc-4a88-b617-410a27e9580d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:30.251489 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcb748-75dc-4a88-b617-410a27e9580d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:30.251843 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcb748-75dc-4a88-b617-410a27e9580d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:30.252679 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcb748-75dc-4a88-b617-410a27e9580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:30.254480 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcb748-75dc-4a88-b617-410a27e9580d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:30.266035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1413/2855] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:30.270165 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7767a6-023b-4384-9b75-cd1396218f8c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:30.281085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7767a6-023b-4384-9b75-cd1396218f8c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:30.285799 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b471e-386e-41d9-bad9-b79e97fb1c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:30.286409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b471e-386e-41d9-bad9-b79e97fb1c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:30.286685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b471e-386e-41d9-bad9-b79e97fb1c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:30.287097 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b471e-386e-41d9-bad9-b79e97fb1c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:30.287787 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b471e-386e-41d9-bad9-b79e97fb1c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:30.289367 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b471e-386e-41d9-bad9-b79e97fb1c6c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:30.290746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:30.301561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1443/2856] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:30.311660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcb748-75dc-4a88-b617-410a27e9580d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:30.322278 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcb748-75dc-4a88-b617-410a27e9580d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:30.328907 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e1387-1e54-451b-8d90-f7e51847e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:30.329996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e1387-1e54-451b-8d90-f7e51847e842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:30.330482 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e1387-1e54-451b-8d90-f7e51847e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:30.330929 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e1387-1e54-451b-8d90-f7e51847e842 admin admin] PATH_INFO: `/v3/projects/e39ce636119a46c6ad402dafdae48a63/users/a8c058a1cc30474dad82f6b9ef2e568f/roles/a9232505007a45c580ef9414aee94847` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:30.334344 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:30.350609 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e1387-1e54-451b-8d90-f7e51847e842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39ce636119a46c6ad402dafdae48a63, user_id=a8c058a1cc30474dad82f6b9ef2e568f, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:30.353249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e1387-1e54-451b-8d90-f7e51847e842 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:30.426026 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1414/2857] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:30 2022] PUT /identity/v3/projects/e39ce636119a46c6ad402dafdae48a63/users/a8c058a1cc30474dad82f6b9ef2e568f/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:30.437200 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f20d1d-8673-4eff-a972-d2145f9f4c81 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:30.437494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f20d1d-8673-4eff-a972-d2145f9f4c81 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:30.437765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f20d1d-8673-4eff-a972-d2145f9f4c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:30.467844 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a4f20d1d-8673-4eff-a972-d2145f9f4c81 None None] MFA Rules not processed for user `a8c058a1cc30474dad82f6b9ef2e568f`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:30.469190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a4f20d1d-8673-4eff-a972-d2145f9f4c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:30.533547 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1444/2858] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:30.544461 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e1387-1e54-451b-8d90-f7e51847e842 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:30.546149 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-da0e1387-1e54-451b-8d90-f7e51847e842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:30.605001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e1387-1e54-451b-8d90-f7e51847e842 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:30.610985 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaf847-631e-4a43-aa03-fc5540892fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:30.611682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaf847-631e-4a43-aa03-fc5540892fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:30.611966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaf847-631e-4a43-aa03-fc5540892fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:30.612240 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaf847-631e-4a43-aa03-fc5540892fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:30.621379 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaf847-631e-4a43-aa03-fc5540892fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:30.622924 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaf847-631e-4a43-aa03-fc5540892fc1 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:30.631799 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1415/2859] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:32.324409 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca9a84-a157-413c-bd93-19cbc1ac796c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:32.324956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca9a84-a157-413c-bd93-19cbc1ac796c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:32.324956 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca9a84-a157-413c-bd93-19cbc1ac796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:32.344977 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-11ca9a84-a157-413c-bd93-19cbc1ac796c None None] MFA Rules not processed for user `a8c058a1cc30474dad82f6b9ef2e568f`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:32.346206 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-11ca9a84-a157-413c-bd93-19cbc1ac796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:32.353188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1445/2860] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:38.062732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaf847-631e-4a43-aa03-fc5540892fc1 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:38.064144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e0aaf847-631e-4a43-aa03-fc5540892fc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:38.131058 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaf847-631e-4a43-aa03-fc5540892fc1 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:38.135624 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:38.136249 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:38.137061 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:38.137405 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] PATH_INFO: `/v3/users/9113ed68f1e44147ac49a7ef3a8e1fbd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:38.138797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9113ed68f1e44147ac49a7ef3a8e1fbd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:38.140714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:38.338094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9113ed68f1e44147ac49a7ef3a8e1fbd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:38.345273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9113ed68f1e44147ac49a7ef3a8e1fbd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:38.346001 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9113ed68f1e44147ac49a7ef3a8e1fbd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:38.346602 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9113ed68f1e44147ac49a7ef3a8e1fbd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:38.390678 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9113ed68f1e44147ac49a7ef3a8e1fbd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:38.408143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1416/2861] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:38 2022] DELETE /identity/v3/users/9113ed68f1e44147ac49a7ef3a8e1fbd => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:38.412725 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae50bec-dd92-4770-a2b0-80fa93a2e0fd None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:38.413175 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae50bec-dd92-4770-a2b0-80fa93a2e0fd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:38.413316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae50bec-dd92-4770-a2b0-80fa93a2e0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:38.431938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2ae50bec-dd92-4770-a2b0-80fa93a2e0fd None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:38.433120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2ae50bec-dd92-4770-a2b0-80fa93a2e0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:38.491238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1446/2862] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:38.501685 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:38.503080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:38.509413 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:38.558102 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5791b4-ffae-4d0e-a2d9-8fbd789a642d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:38.562274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf1bc5-80cf-4336-a75a-d368d5475a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:38.562861 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf1bc5-80cf-4336-a75a-d368d5475a6a service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:38.563132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf1bc5-80cf-4336-a75a-d368d5475a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:38.563397 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf1bc5-80cf-4336-a75a-d368d5475a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:38.572306 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf1bc5-80cf-4336-a75a-d368d5475a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:38.573864 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf1bc5-80cf-4336-a75a-d368d5475a6a service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:38.584037 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1417/2863] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:38.990554 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae50bec-dd92-4770-a2b0-80fa93a2e0fd None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:38.992054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2ae50bec-dd92-4770-a2b0-80fa93a2e0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:39.004491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae50bec-dd92-4770-a2b0-80fa93a2e0fd None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:39.008978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:39.009629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.009906 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.010174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] PATH_INFO: `/v3/projects/9d36988faf134867a226b854e0733ad2` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.011280 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d36988faf134867a226b854e0733ad2)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:39.013258 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:39.127004 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d36988faf134867a226b854e0733ad2', 'request_id': 'req-39ee2f56-0be0-4c81-88f1-cb9615908638'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:39.132423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d36988faf134867a226b854e0733ad2', 'request_id': 'req-39ee2f56-0be0-4c81-88f1-cb9615908638'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:39.138889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d36988faf134867a226b854e0733ad2', 'request_id': 'req-39ee2f56-0be0-4c81-88f1-cb9615908638'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:39.217777 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] The token cache is being invalidate because project 9d36988faf134867a226b854e0733ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:39.218064 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:39.218669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39ee2f56-0be0-4c81-88f1-cb9615908638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:39.220140 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1447/2864] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:38 2022] DELETE /identity/v3/projects/9d36988faf134867a226b854e0733ad2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:39.225407 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515f254-3b0d-42fc-ab7e-5d5659bfe23d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.225925 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515f254-3b0d-42fc-ab7e-5d5659bfe23d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.226132 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515f254-3b0d-42fc-ab7e-5d5659bfe23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.246659 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e515f254-3b0d-42fc-ab7e-5d5659bfe23d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:39.247855 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e515f254-3b0d-42fc-ab7e-5d5659bfe23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:39.306618 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1418/2865] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:39.315383 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29fc5-c19a-4055-9787-0f5a4e680e9c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.315664 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29fc5-c19a-4055-9787-0f5a4e680e9c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.315938 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29fc5-c19a-4055-9787-0f5a4e680e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.323514 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:39.335764 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6dc29fc5-c19a-4055-9787-0f5a4e680e9c None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:39.337002 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6dc29fc5-c19a-4055-9787-0f5a4e680e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:39.345667 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1448/2866] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:39.349903 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515f254-3b0d-42fc-ab7e-5d5659bfe23d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:39.360086 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515f254-3b0d-42fc-ab7e-5d5659bfe23d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:39.364882 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42c4df-2787-4b03-a113-e39ae3f30744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:39.370171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42c4df-2787-4b03-a113-e39ae3f30744 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.370171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42c4df-2787-4b03-a113-e39ae3f30744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.370171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42c4df-2787-4b03-a113-e39ae3f30744 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.370171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42c4df-2787-4b03-a113-e39ae3f30744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:39.370171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42c4df-2787-4b03-a113-e39ae3f30744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:39.370171 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42c4df-2787-4b03-a113-e39ae3f30744 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:39.380525 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1419/2867] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:11:39.384729 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc29fc5-c19a-4055-9787-0f5a4e680e9c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:39.394239 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc29fc5-c19a-4055-9787-0f5a4e680e9c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:39.404759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2cc0d-7134-43b4-9a58-9e4a87135afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:39.404759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2cc0d-7134-43b4-9a58-9e4a87135afc admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.404759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2cc0d-7134-43b4-9a58-9e4a87135afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.404759 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2cc0d-7134-43b4-9a58-9e4a87135afc admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.405176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2cc0d-7134-43b4-9a58-9e4a87135afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:39.405176 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2cc0d-7134-43b4-9a58-9e4a87135afc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:39.492754 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1449/2868] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:39 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:39.497074 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42c4df-2787-4b03-a113-e39ae3f30744 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:39.507331 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42c4df-2787-4b03-a113-e39ae3f30744 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:39.562452 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2998821-6b40-43a2-9932-440d357e6c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:39.563050 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2998821-6b40-43a2-9932-440d357e6c3a admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.563322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2998821-6b40-43a2-9932-440d357e6c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.563589 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2998821-6b40-43a2-9932-440d357e6c3a admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.564196 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2998821-6b40-43a2-9932-440d357e6c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:39.566145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2998821-6b40-43a2-9932-440d357e6c3a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:39.648535 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1420/2869] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:39 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:11:39.653889 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2cc0d-7134-43b4-9a58-9e4a87135afc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:39.664384 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2cc0d-7134-43b4-9a58-9e4a87135afc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:39.669483 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fa91c-57e8-4f67-b0dc-03a4d3b0bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:39.674398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fa91c-57e8-4f67-b0dc-03a4d3b0bdef admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.674398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fa91c-57e8-4f67-b0dc-03a4d3b0bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.674398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fa91c-57e8-4f67-b0dc-03a4d3b0bdef admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.674398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fa91c-57e8-4f67-b0dc-03a4d3b0bdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:39.674398 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fa91c-57e8-4f67-b0dc-03a4d3b0bdef admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:39.682660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1450/2870] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:39.686688 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2998821-6b40-43a2-9932-440d357e6c3a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:39.696474 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2998821-6b40-43a2-9932-440d357e6c3a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:39.701729 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8902e-17c7-4cb7-9d61-8cd54624cf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:39.703125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8902e-17c7-4cb7-9d61-8cd54624cf18 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.703125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8902e-17c7-4cb7-9d61-8cd54624cf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.703125 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8902e-17c7-4cb7-9d61-8cd54624cf18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.703450 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8902e-17c7-4cb7-9d61-8cd54624cf18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:39.705013 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8902e-17c7-4cb7-9d61-8cd54624cf18 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:39.716292 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1421/2871] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:39.720321 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fa91c-57e8-4f67-b0dc-03a4d3b0bdef admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:39.730422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fa91c-57e8-4f67-b0dc-03a4d3b0bdef admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:39.735266 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d8b6a-d02b-4176-8902-6193a27d2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:39.735903 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d8b6a-d02b-4176-8902-6193a27d2b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.736179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d8b6a-d02b-4176-8902-6193a27d2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.736452 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d8b6a-d02b-4176-8902-6193a27d2b79 admin admin] PATH_INFO: `/v3/projects/7ecf98918edf4e98b38715c58d810e0d/users/47dce0929e314031a91576710f330e69/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.752583 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d8b6a-d02b-4176-8902-6193a27d2b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecf98918edf4e98b38715c58d810e0d, user_id=47dce0929e314031a91576710f330e69, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:39.755303 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d8b6a-d02b-4176-8902-6193a27d2b79 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:39.843329 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1451/2872] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:39 2022] PUT /identity/v3/projects/7ecf98918edf4e98b38715c58d810e0d/users/47dce0929e314031a91576710f330e69/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:39.852483 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b614-97eb-46dc-9697-1981e0b901fc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:39.852765 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b614-97eb-46dc-9697-1981e0b901fc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:39.853035 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0b614-97eb-46dc-9697-1981e0b901fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:39.877860 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:39.880661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-04f0b614-97eb-46dc-9697-1981e0b901fc None None] MFA Rules not processed for user `47dce0929e314031a91576710f330e69`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:39.881884 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-04f0b614-97eb-46dc-9697-1981e0b901fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:39.947285 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1422/2873] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:39.952376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d8b6a-d02b-4176-8902-6193a27d2b79 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:40.012669 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d8b6a-d02b-4176-8902-6193a27d2b79 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:40.017292 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f58e-eb34-4581-9f6b-a75781d45bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:40.017914 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f58e-eb34-4581-9f6b-a75781d45bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:40.018208 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f58e-eb34-4581-9f6b-a75781d45bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:40.018459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f58e-eb34-4581-9f6b-a75781d45bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:40.019069 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f58e-eb34-4581-9f6b-a75781d45bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:40.020959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f58e-eb34-4581-9f6b-a75781d45bc9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:40.116093 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1452/2874] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:39 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:40.120242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b614-97eb-46dc-9697-1981e0b901fc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:40.131512 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0b614-97eb-46dc-9697-1981e0b901fc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:40.190020 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6ec1f-c573-458b-a629-8a8eeabb17f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:40.190633 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6ec1f-c573-458b-a629-8a8eeabb17f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:40.190913 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6ec1f-c573-458b-a629-8a8eeabb17f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:40.191185 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6ec1f-c573-458b-a629-8a8eeabb17f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:40.191823 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6ec1f-c573-458b-a629-8a8eeabb17f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:40.193759 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6ec1f-c573-458b-a629-8a8eeabb17f8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:40.303362 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1423/2875] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:40 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:40.307119 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f58e-eb34-4581-9f6b-a75781d45bc9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:40.318488 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f58e-eb34-4581-9f6b-a75781d45bc9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:40.323311 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60671b04-3589-44b0-86b2-5512a80e70a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:40.323909 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671b04-3589-44b0-86b2-5512a80e70a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:40.324286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671b04-3589-44b0-86b2-5512a80e70a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:40.324559 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671b04-3589-44b0-86b2-5512a80e70a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:40.325235 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60671b04-3589-44b0-86b2-5512a80e70a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:40.326878 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60671b04-3589-44b0-86b2-5512a80e70a3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:40.337511 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1453/2876] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:40.341652 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6ec1f-c573-458b-a629-8a8eeabb17f8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:40.351782 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6ec1f-c573-458b-a629-8a8eeabb17f8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:40.357195 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54bc13-83c6-484e-962b-2891b1d1cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:40.357819 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54bc13-83c6-484e-962b-2891b1d1cdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:40.358098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54bc13-83c6-484e-962b-2891b1d1cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:40.358408 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54bc13-83c6-484e-962b-2891b1d1cdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:40.359052 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54bc13-83c6-484e-962b-2891b1d1cdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:40.360631 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54bc13-83c6-484e-962b-2891b1d1cdc8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:40.370926 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1424/2877] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:40.375593 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60671b04-3589-44b0-86b2-5512a80e70a3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:40.385422 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60671b04-3589-44b0-86b2-5512a80e70a3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:40.390017 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14869cc-c9ea-4b23-8158-8ab29aa6a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:40.390648 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14869cc-c9ea-4b23-8158-8ab29aa6a716 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:40.390921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14869cc-c9ea-4b23-8158-8ab29aa6a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:40.391188 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14869cc-c9ea-4b23-8158-8ab29aa6a716 admin admin] PATH_INFO: `/v3/projects/44a1a6737166432c852651e4bff70d7d/users/136a3e36f7be4534b0c03a4799bc85ff/roles/a9232505007a45c580ef9414aee94847` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:40.405250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14869cc-c9ea-4b23-8158-8ab29aa6a716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a1a6737166432c852651e4bff70d7d, user_id=136a3e36f7be4534b0c03a4799bc85ff, role_id=a9232505007a45c580ef9414aee94847)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:40.407894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14869cc-c9ea-4b23-8158-8ab29aa6a716 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:40.515039 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1454/2878] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:40 2022] PUT /identity/v3/projects/44a1a6737166432c852651e4bff70d7d/users/136a3e36f7be4534b0c03a4799bc85ff/roles/a9232505007a45c580ef9414aee94847 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:40.525245 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b30cf-1a71-4faf-942d-a765c1076d32 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:40.525647 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b30cf-1a71-4faf-942d-a765c1076d32 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:40.530394 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b30cf-1a71-4faf-942d-a765c1076d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:40.553942 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f66b30cf-1a71-4faf-942d-a765c1076d32 None None] MFA Rules not processed for user `136a3e36f7be4534b0c03a4799bc85ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:40.555143 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f66b30cf-1a71-4faf-942d-a765c1076d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:40.623969 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1425/2879] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:40.628505 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14869cc-c9ea-4b23-8158-8ab29aa6a716 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:40.678124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:40.691266 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14869cc-c9ea-4b23-8158-8ab29aa6a716 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:40.695941 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0db85-a609-4962-9bb1-f4ee8c54f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:40.696536 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0db85-a609-4962-9bb1-f4ee8c54f5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:40.696816 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0db85-a609-4962-9bb1-f4ee8c54f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:40.697088 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0db85-a609-4962-9bb1-f4ee8c54f5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:40.697733 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0db85-a609-4962-9bb1-f4ee8c54f5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:40.699632 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0db85-a609-4962-9bb1-f4ee8c54f5f9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:40.812731 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1455/2880] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:40 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:40.816748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b30cf-1a71-4faf-942d-a765c1076d32 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:40.827421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b30cf-1a71-4faf-942d-a765c1076d32 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:40.835281 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:40.885744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40683a-2fd5-49e8-a88b-b01c0a52dc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:40.886351 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40683a-2fd5-49e8-a88b-b01c0a52dc01 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:40.886703 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40683a-2fd5-49e8-a88b-b01c0a52dc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:40.886980 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40683a-2fd5-49e8-a88b-b01c0a52dc01 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:40.887730 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40683a-2fd5-49e8-a88b-b01c0a52dc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:40.889695 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40683a-2fd5-49e8-a88b-b01c0a52dc01 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:40.995315 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1426/2881] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:40 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:40.999852 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0db85-a609-4962-9bb1-f4ee8c54f5f9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:41.010095 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0db85-a609-4962-9bb1-f4ee8c54f5f9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:41.015551 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaeda3e-f6fa-4f46-8a2d-4af6d0880bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:41.016147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeda3e-f6fa-4f46-8a2d-4af6d0880bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:41.016423 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeda3e-f6fa-4f46-8a2d-4af6d0880bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:41.016685 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaeda3e-f6fa-4f46-8a2d-4af6d0880bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:41.017316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaeda3e-f6fa-4f46-8a2d-4af6d0880bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:41.018971 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaeda3e-f6fa-4f46-8a2d-4af6d0880bb5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:41.030121 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1456/2882] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:41.034282 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40683a-2fd5-49e8-a88b-b01c0a52dc01 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:41.044619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40683a-2fd5-49e8-a88b-b01c0a52dc01 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:41.049321 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911aa48-8678-4d15-be86-22b5b6254f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:41.049994 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911aa48-8678-4d15-be86-22b5b6254f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:41.050277 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911aa48-8678-4d15-be86-22b5b6254f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:41.050546 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911aa48-8678-4d15-be86-22b5b6254f64 admin admin] PATH_INFO: `/v3/projects/88cfc79e55b24280afcc6db916f1d63c/users/568cdf8a5c24414a978e074b720cb176/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:41.067501 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911aa48-8678-4d15-be86-22b5b6254f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cfc79e55b24280afcc6db916f1d63c, user_id=568cdf8a5c24414a978e074b720cb176, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:41.068995 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911aa48-8678-4d15-be86-22b5b6254f64 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:41.167746 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1427/2883] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:41 2022] PUT /identity/v3/projects/88cfc79e55b24280afcc6db916f1d63c/users/568cdf8a5c24414a978e074b720cb176/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:41.172046 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaeda3e-f6fa-4f46-8a2d-4af6d0880bb5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:41.182116 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaeda3e-f6fa-4f46-8a2d-4af6d0880bb5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:41.240660 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5210e-3e27-4ce5-a30e-c11d3f25754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:41.241296 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5210e-3e27-4ce5-a30e-c11d3f25754d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:41.241613 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5210e-3e27-4ce5-a30e-c11d3f25754d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:41.241886 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5210e-3e27-4ce5-a30e-c11d3f25754d admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:41.242526 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5210e-3e27-4ce5-a30e-c11d3f25754d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:41.244118 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5210e-3e27-4ce5-a30e-c11d3f25754d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:41.254403 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1457/2884] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:41.259537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911aa48-8678-4d15-be86-22b5b6254f64 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:41.270448 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911aa48-8678-4d15-be86-22b5b6254f64 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:41.274996 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f886cdf-3f86-47e2-9494-826f3c40b9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:41.275630 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f886cdf-3f86-47e2-9494-826f3c40b9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:41.275902 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f886cdf-3f86-47e2-9494-826f3c40b9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:41.276168 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f886cdf-3f86-47e2-9494-826f3c40b9d4 admin admin] PATH_INFO: `/v3/projects/88cfc79e55b24280afcc6db916f1d63c/users/568cdf8a5c24414a978e074b720cb176/roles/7d5fa916535a4fd5a8e3d51efb289f6a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:41.278840 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f886cdf-3f86-47e2-9494-826f3c40b9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cfc79e55b24280afcc6db916f1d63c, user_id=568cdf8a5c24414a978e074b720cb176, role_id=7d5fa916535a4fd5a8e3d51efb289f6a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:41.281424 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f886cdf-3f86-47e2-9494-826f3c40b9d4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:41.292262 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1428/2885] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:41 2022] PUT /identity/v3/projects/88cfc79e55b24280afcc6db916f1d63c/users/568cdf8a5c24414a978e074b720cb176/roles/7d5fa916535a4fd5a8e3d51efb289f6a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:41.303849 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870967-8114-4f70-9b01-8f1d33e4af0e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:41.304211 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870967-8114-4f70-9b01-8f1d33e4af0e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:41.304491 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870967-8114-4f70-9b01-8f1d33e4af0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:41.335761 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-85870967-8114-4f70-9b01-8f1d33e4af0e None None] MFA Rules not processed for user `568cdf8a5c24414a978e074b720cb176`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:41.336916 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-85870967-8114-4f70-9b01-8f1d33e4af0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:41.424762 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1458/2886] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:41.433106 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f886cdf-3f86-47e2-9494-826f3c40b9d4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:41.436714 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0f886cdf-3f86-47e2-9494-826f3c40b9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:41.504174 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f886cdf-3f86-47e2-9494-826f3c40b9d4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:41.507737 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef410f3-a5c2-43fd-bc5d-598a3f111ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:41.508337 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef410f3-a5c2-43fd-bc5d-598a3f111ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:41.508619 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef410f3-a5c2-43fd-bc5d-598a3f111ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:41.508886 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef410f3-a5c2-43fd-bc5d-598a3f111ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:41.565725 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef410f3-a5c2-43fd-bc5d-598a3f111ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:41.567145 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef410f3-a5c2-43fd-bc5d-598a3f111ca6 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:41.576415 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1429/2887] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:43.509763 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870967-8114-4f70-9b01-8f1d33e4af0e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:43.511316 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-85870967-8114-4f70-9b01-8f1d33e4af0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:43.524056 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870967-8114-4f70-9b01-8f1d33e4af0e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:43.528236 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e07f6c-48a9-444f-9029-abfb5f16cab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:43.528921 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e07f6c-48a9-444f-9029-abfb5f16cab6 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:43.529269 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e07f6c-48a9-444f-9029-abfb5f16cab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:43.529570 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e07f6c-48a9-444f-9029-abfb5f16cab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:43.573242 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:43.588663 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e07f6c-48a9-444f-9029-abfb5f16cab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:43.591013 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e07f6c-48a9-444f-9029-abfb5f16cab6 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:43.599926 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1459/2888] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:45.022814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef410f3-a5c2-43fd-bc5d-598a3f111ca6 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:45.032317 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef410f3-a5c2-43fd-bc5d-598a3f111ca6 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:45.036016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cec27f-6826-4d77-a28a-29c669eae81f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23734a2b701a46c3a25ae547aff98026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:45.036610 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cec27f-6826-4d77-a28a-29c669eae81f service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:45.037010 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cec27f-6826-4d77-a28a-29c669eae81f service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:45.037287 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cec27f-6826-4d77-a28a-29c669eae81f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:45.046711 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cec27f-6826-4d77-a28a-29c669eae81f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:45.048117 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cec27f-6826-4d77-a28a-29c669eae81f service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:45.057543 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1430/2889] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:49.810494 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e07f6c-48a9-444f-9029-abfb5f16cab6 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:49.873553 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e07f6c-48a9-444f-9029-abfb5f16cab6 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:49.878036 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:49.878655 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:49.878929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:49.879489 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] PATH_INFO: `/v3/users/47dce0929e314031a91576710f330e69` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:49.880640 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47dce0929e314031a91576710f330e69)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:49.882561 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:50.049719 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47dce0929e314031a91576710f330e69'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:50.050376 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47dce0929e314031a91576710f330e69'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:50.050978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47dce0929e314031a91576710f330e69'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:50.110394 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47dce0929e314031a91576710f330e69'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:50.124768 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47dce0929e314031a91576710f330e69'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:50.139387 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1460/2890] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:49 2022] DELETE /identity/v3/users/47dce0929e314031a91576710f330e69 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:50.143712 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c93bc6-652c-4310-afa2-2fca6406513d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:50.149570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c93bc6-652c-4310-afa2-2fca6406513d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:50.149570 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c93bc6-652c-4310-afa2-2fca6406513d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:50.152797 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:50.163322 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c4c93bc6-652c-4310-afa2-2fca6406513d None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:50.164544 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c4c93bc6-652c-4310-afa2-2fca6406513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:50.223118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1431/2891] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:50.237982 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:50.239623 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:50.297407 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda322-6d41-43e2-927a-bc24aa609907 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:50.300939 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e7be2-31d6-4304-8746-de70835f48e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:50.301560 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e7be2-31d6-4304-8746-de70835f48e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:50.301834 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e7be2-31d6-4304-8746-de70835f48e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:50.302099 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e7be2-31d6-4304-8746-de70835f48e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:50.311584 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e7be2-31d6-4304-8746-de70835f48e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:50.312987 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e7be2-31d6-4304-8746-de70835f48e1 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:50.323317 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1461/2892] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:50.940346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c93bc6-652c-4310-afa2-2fca6406513d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:50.943764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c4c93bc6-652c-4310-afa2-2fca6406513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:50.954242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c93bc6-652c-4310-afa2-2fca6406513d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:50.959274 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:50.959938 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:50.960211 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:50.960634 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] PATH_INFO: `/v3/projects/7ecf98918edf4e98b38715c58d810e0d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:50.961875 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecf98918edf4e98b38715c58d810e0d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:50.965016 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:51.103070 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecf98918edf4e98b38715c58d810e0d', 'request_id': 'req-9152c660-ca3a-40cd-9c9f-4579c69574d0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.108947 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecf98918edf4e98b38715c58d810e0d', 'request_id': 'req-9152c660-ca3a-40cd-9c9f-4579c69574d0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.115516 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecf98918edf4e98b38715c58d810e0d', 'request_id': 'req-9152c660-ca3a-40cd-9c9f-4579c69574d0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.192098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] The token cache is being invalidate because project 7ecf98918edf4e98b38715c58d810e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:51.192098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.192098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9152c660-ca3a-40cd-9c9f-4579c69574d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.192098 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1432/2893] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:50 2022] DELETE /identity/v3/projects/7ecf98918edf4e98b38715c58d810e0d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:51.195286 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e7be2-31d6-4304-8746-de70835f48e1 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:51.202661 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:51.207263 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e7be2-31d6-4304-8746-de70835f48e1 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:51.263577 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:51.264344 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:51.264627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:51.264946 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] PATH_INFO: `/v3/users/136a3e36f7be4534b0c03a4799bc85ff` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:51.266204 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=136a3e36f7be4534b0c03a4799bc85ff)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:51.268257 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:51.468629 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136a3e36f7be4534b0c03a4799bc85ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.469529 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136a3e36f7be4534b0c03a4799bc85ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.471271 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136a3e36f7be4534b0c03a4799bc85ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.475581 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c4bc-1866-48bd-a763-735ede4de2f3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:51.475871 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c4bc-1866-48bd-a763-735ede4de2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:51.476144 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c4bc-1866-48bd-a763-735ede4de2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:51.506299 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1766c4bc-1866-48bd-a763-735ede4de2f3 None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:51.507487 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1766c4bc-1866-48bd-a763-735ede4de2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:51.538668 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136a3e36f7be4534b0c03a4799bc85ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.552509 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136a3e36f7be4534b0c03a4799bc85ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:51.563069 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1433/2894] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:11:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:51.565734 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1462/2895] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:51 2022] DELETE /identity/v3/users/136a3e36f7be4534b0c03a4799bc85ff => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:51.737178 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766c4bc-1866-48bd-a763-735ede4de2f3 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:51.738627 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1766c4bc-1866-48bd-a763-735ede4de2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:51.767033 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:51.812375 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766c4bc-1866-48bd-a763-735ede4de2f3 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:51.875059 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c153d2-6049-4751-b3d4-25cc5171a09f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:51.875673 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c153d2-6049-4751-b3d4-25cc5171a09f service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:51.875949 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c153d2-6049-4751-b3d4-25cc5171a09f service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:51.876222 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c153d2-6049-4751-b3d4-25cc5171a09f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:51.932352 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c153d2-6049-4751-b3d4-25cc5171a09f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:51.934573 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c153d2-6049-4751-b3d4-25cc5171a09f service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:51.942632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1434/2896] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:11:52.019392 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:52.025285 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:52.093291 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52be462-ffef-4459-b922-0e028a96daaf admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:52.098988 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:52.099620 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:52.099894 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:52.100162 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] PATH_INFO: `/v3/projects/44a1a6737166432c852651e4bff70d7d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:52.101278 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a1a6737166432c852651e4bff70d7d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:52.103191 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:52.202411 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:52.218726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a1a6737166432c852651e4bff70d7d', 'request_id': 'req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.224250 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a1a6737166432c852651e4bff70d7d', 'request_id': 'req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.231124 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a1a6737166432c852651e4bff70d7d', 'request_id': 'req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.336518 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] The token cache is being invalidate because project 44a1a6737166432c852651e4bff70d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:52.336807 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.337429 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a168ab7a-f64a-44d2-8af4-aaf06c36fa2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.339091 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1463/2897] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:52 2022] DELETE /identity/v3/projects/44a1a6737166432c852651e4bff70d7d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:52.343230 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c153d2-6049-4751-b3d4-25cc5171a09f service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:52.354271 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c153d2-6049-4751-b3d4-25cc5171a09f service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:52.423537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:52.424158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:52.424429 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:52.424696 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] PATH_INFO: `/v3/users/568cdf8a5c24414a978e074b720cb176` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:52.425948 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568cdf8a5c24414a978e074b720cb176)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:52.427710 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:52.438732 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:52.647550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568cdf8a5c24414a978e074b720cb176'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.655008 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568cdf8a5c24414a978e074b720cb176'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.655670 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568cdf8a5c24414a978e074b720cb176'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.656264 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568cdf8a5c24414a978e074b720cb176'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.721353 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568cdf8a5c24414a978e074b720cb176'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.748682 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1435/2898] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:52 2022] DELETE /identity/v3/users/568cdf8a5c24414a978e074b720cb176 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:52.768267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f929e67-2dce-4206-a238-f317dc4f6863 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:52.768267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f929e67-2dce-4206-a238-f317dc4f6863 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:52.768267 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f929e67-2dce-4206-a238-f317dc4f6863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:52.790950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8f929e67-2dce-4206-a238-f317dc4f6863 None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:52.790950 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8f929e67-2dce-4206-a238-f317dc4f6863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:52.852604 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1464/2899] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 08:11:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:52.870872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:52.870872 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:52.938118 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a600929-749f-48f1-a8c2-f459281f18e7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:52.944666 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd344444-9750-4620-b833-2c16c2be33c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:52.945158 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd344444-9750-4620-b833-2c16c2be33c9 service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:52.945669 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd344444-9750-4620-b833-2c16c2be33c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:52.945814 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd344444-9750-4620-b833-2c16c2be33c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:52.958773 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd344444-9750-4620-b833-2c16c2be33c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:52.960411 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd344444-9750-4620-b833-2c16c2be33c9 service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:52.971192 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1436/2900] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:11:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:11:53.197333 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f929e67-2dce-4206-a238-f317dc4f6863 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:53.199473 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8f929e67-2dce-4206-a238-f317dc4f6863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:53.269724 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f929e67-2dce-4206-a238-f317dc4f6863 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:53.274721 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:53.275392 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.275666 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.275933 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] PATH_INFO: `/v3/projects/88cfc79e55b24280afcc6db916f1d63c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.277706 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88cfc79e55b24280afcc6db916f1d63c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:53.279622 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:53.386749 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88cfc79e55b24280afcc6db916f1d63c', 'request_id': 'req-c9e2793c-f0be-497a-87fd-4d4d81699891'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.392342 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88cfc79e55b24280afcc6db916f1d63c', 'request_id': 'req-c9e2793c-f0be-497a-87fd-4d4d81699891'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.394225 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:53.398626 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88cfc79e55b24280afcc6db916f1d63c', 'request_id': 'req-c9e2793c-f0be-497a-87fd-4d4d81699891'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.532009 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] The token cache is being invalidate because project 88cfc79e55b24280afcc6db916f1d63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:53.532299 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.532929 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.534453 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1465/2901] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:53 2022] DELETE /identity/v3/projects/88cfc79e55b24280afcc6db916f1d63c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:53.608175 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dd5d3-b0fd-4c26-a4c0-737defa657d7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.608747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dd5d3-b0fd-4c26-a4c0-737defa657d7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.608747 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dd5d3-b0fd-4c26-a4c0-737defa657d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.630458 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-344dd5d3-b0fd-4c26-a4c0-737defa657d7 None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:53.633094 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-344dd5d3-b0fd-4c26-a4c0-737defa657d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:53.694284 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1437/2902] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 08:11:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:53.707463 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:53.708942 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:53.788542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2793c-f0be-497a-87fd-4d4d81699891 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:53.794138 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fb594-0a77-41b5-97dc-1b969d9dd206 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:53.794770 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fb594-0a77-41b5-97dc-1b969d9dd206 service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.795049 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fb594-0a77-41b5-97dc-1b969d9dd206 service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.795320 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fb594-0a77-41b5-97dc-1b969d9dd206 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.804674 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fb594-0a77-41b5-97dc-1b969d9dd206 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:53.806300 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fb594-0a77-41b5-97dc-1b969d9dd206 service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:53.815035 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1466/2903] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:11:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:11:54.414393 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c645f6-e549-499d-a71b-b4c5fd7df384 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:54.414674 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c645f6-e549-499d-a71b-b4c5fd7df384 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:54.414968 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c645f6-e549-499d-a71b-b4c5fd7df384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:54.434854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-77c645f6-e549-499d-a71b-b4c5fd7df384 None None] MFA Rules not processed for user `97a62895f65f4e6aaa23d2941ed43d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:54.435957 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77c645f6-e549-499d-a71b-b4c5fd7df384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:54.443036 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1438/2904] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 08:11:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:54.455896 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fb594-0a77-41b5-97dc-1b969d9dd206 service swift] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:54.466989 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fb594-0a77-41b5-97dc-1b969d9dd206 service swift] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:54.472146 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0874f2-69be-4723-828a-5e5ffb2e5653 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f362b8daae13435a9a468b06c4998c67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:54.472765 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0874f2-69be-4723-828a-5e5ffb2e5653 service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:54.473043 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0874f2-69be-4723-828a-5e5ffb2e5653 service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:54.473312 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0874f2-69be-4723-828a-5e5ffb2e5653 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:54.482158 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0874f2-69be-4723-828a-5e5ffb2e5653 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:54.483746 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0874f2-69be-4723-828a-5e5ffb2e5653 service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:54.492059 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1467/2905] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 08:11:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:11:57.137176 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c645f6-e549-499d-a71b-b4c5fd7df384 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:57.138632 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77c645f6-e549-499d-a71b-b4c5fd7df384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:57.157518 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:57.204770 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c645f6-e549-499d-a71b-b4c5fd7df384 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:57.209314 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:57.211366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:57.211366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:57.211366 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] PATH_INFO: `/v3/users/a8c058a1cc30474dad82f6b9ef2e568f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:57.211690 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c058a1cc30474dad82f6b9ef2e568f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:57.213550 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:57.352162 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c058a1cc30474dad82f6b9ef2e568f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:57.359851 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c058a1cc30474dad82f6b9ef2e568f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:57.360582 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c058a1cc30474dad82f6b9ef2e568f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:57.361184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c058a1cc30474dad82f6b9ef2e568f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:57.445661 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c058a1cc30474dad82f6b9ef2e568f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:57.465157 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1439/2906] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:57 2022] DELETE /identity/v3/users/a8c058a1cc30474dad82f6b9ef2e568f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:57.469680 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548b8a5-d33c-4ec1-a03b-e13d8ab70cd8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:57.470143 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548b8a5-d33c-4ec1-a03b-e13d8ab70cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:57.470241 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548b8a5-d33c-4ec1-a03b-e13d8ab70cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:57.489366 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6548b8a5-d33c-4ec1-a03b-e13d8ab70cd8 None None] MFA Rules not processed for user `57c499431d554526bf65401b415ad207`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:57.490595 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6548b8a5-d33c-4ec1-a03b-e13d8ab70cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:57.550148 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1468/2907] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 08:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:57.560080 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:57.561494 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:57.626744 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675a17-5f0b-48bc-b07d-d6c9fa41befe admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:57.630471 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796b04e-d4ad-4b4f-a759-b2ac07226a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d07f93b7540128dc5415d8b3252c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:57.631072 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796b04e-d4ad-4b4f-a759-b2ac07226a28 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:57.631346 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796b04e-d4ad-4b4f-a759-b2ac07226a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:57.631614 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796b04e-d4ad-4b4f-a759-b2ac07226a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:57.641756 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796b04e-d4ad-4b4f-a759-b2ac07226a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:57.643242 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796b04e-d4ad-4b4f-a759-b2ac07226a28 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:57.653612 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1440/2908] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:57.894955 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548b8a5-d33c-4ec1-a03b-e13d8ab70cd8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:57.902112 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6548b8a5-d33c-4ec1-a03b-e13d8ab70cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:57.908726 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548b8a5-d33c-4ec1-a03b-e13d8ab70cd8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:57.913306 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:57.913978 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:57.914256 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:57.914525 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] PATH_INFO: `/v3/projects/e39ce636119a46c6ad402dafdae48a63` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:57.915671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39ce636119a46c6ad402dafdae48a63)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:57.918073 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:58.019087 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39ce636119a46c6ad402dafdae48a63', 'request_id': 'req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:58.024490 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39ce636119a46c6ad402dafdae48a63', 'request_id': 'req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:58.026322 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:58.031179 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39ce636119a46c6ad402dafdae48a63', 'request_id': 'req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:58.127627 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] The token cache is being invalidate because project e39ce636119a46c6ad402dafdae48a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:58.128003 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:58.128671 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:58.130238 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1469/2909] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:57 2022] DELETE /identity/v3/projects/e39ce636119a46c6ad402dafdae48a63 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:12:07.648637 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:08.184974 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:48.589983 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796b04e-d4ad-4b4f-a759-b2ac07226a28 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:48.591557 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7796b04e-d4ad-4b4f-a759-b2ac07226a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:48.605208 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796b04e-d4ad-4b4f-a759-b2ac07226a28 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:48.661574 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:48.662184 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:48.662459 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:48.662790 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] PATH_INFO: `/v3/users/3ba741b1b62747a397193baa0b5b07a0` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:48.663920 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba741b1b62747a397193baa0b5b07a0)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:48.665856 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:48.846963 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba741b1b62747a397193baa0b5b07a0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:48.853748 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba741b1b62747a397193baa0b5b07a0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:48.854421 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba741b1b62747a397193baa0b5b07a0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:48.855130 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba741b1b62747a397193baa0b5b07a0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:48.930809 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba741b1b62747a397193baa0b5b07a0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:48.949078 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1441/2910] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:12:48 2022] DELETE /identity/v3/users/3ba741b1b62747a397193baa0b5b07a0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:12:49.230459 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:49.231981 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:49.246539 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125ddd-e8dc-4fc8-8ffd-4d82f04c0d2c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:49.304472 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:49.305103 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:49.305382 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:49.305687 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] PATH_INFO: `/v3/projects/173df644f72f4f9b9fbcd5c1623cc89e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:49.306811 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] RBAC: Authorizing `identity:delete_project(project_id=173df644f72f4f9b9fbcd5c1623cc89e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:49.308710 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:49.412368 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173df644f72f4f9b9fbcd5c1623cc89e', 'request_id': 'req-2636bb85-0591-46be-b756-03221581fefe'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.417928 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173df644f72f4f9b9fbcd5c1623cc89e', 'request_id': 'req-2636bb85-0591-46be-b756-03221581fefe'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.424195 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173df644f72f4f9b9fbcd5c1623cc89e', 'request_id': 'req-2636bb85-0591-46be-b756-03221581fefe'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.495959 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] The token cache is being invalidate because project 173df644f72f4f9b9fbcd5c1623cc89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:12:49.496174 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.496810 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.498315 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1470/2911] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:12:49 2022] DELETE /identity/v3/projects/173df644f72f4f9b9fbcd5c1623cc89e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:12:49.502428 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:49.503811 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:49.516537 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b85d6-4474-41c4-a290-cecc015394d4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:49.572273 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:49.572890 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:49.573166 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:49.573433 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] PATH_INFO: `/v3/users/22297cfacfa74a01b041a2879593293d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:49.574572 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22297cfacfa74a01b041a2879593293d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:49.576541 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:49.599993 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:49.767847 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22297cfacfa74a01b041a2879593293d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.775533 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22297cfacfa74a01b041a2879593293d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.776205 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22297cfacfa74a01b041a2879593293d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.776813 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22297cfacfa74a01b041a2879593293d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.816854 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22297cfacfa74a01b041a2879593293d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:49.834966 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1442/2912] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 08:12:49 2022] DELETE /identity/v3/users/22297cfacfa74a01b041a2879593293d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:12:50.081147 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:50.083592 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:50.097120 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636bb85-0591-46be-b756-03221581fefe admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:50.155190 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57c499431d554526bf65401b415ad207', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28aa92351f744eeb9273dbf7547e3314', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:50.160540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:50.160540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:50.160540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] PATH_INFO: `/v3/projects/cb531af4ea6b41e0b97a08db51b39fdd` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:50.160540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb531af4ea6b41e0b97a08db51b39fdd)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:50.160540 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:50.247085 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:50.261454 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb531af4ea6b41e0b97a08db51b39fdd', 'request_id': 'req-a1eb7732-21b7-4c3e-841d-f2deca934940'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:50.267264 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb531af4ea6b41e0b97a08db51b39fdd', 'request_id': 'req-a1eb7732-21b7-4c3e-841d-f2deca934940'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:50.274326 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb531af4ea6b41e0b97a08db51b39fdd', 'request_id': 'req-a1eb7732-21b7-4c3e-841d-f2deca934940'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:50.353683 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] The token cache is being invalidate because project cb531af4ea6b41e0b97a08db51b39fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:12:50.353883 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:50.354515 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a1eb7732-21b7-4c3e-841d-f2deca934940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:50.356054 dv-cinder-852209-7-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1471/2913] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 08:12:50 2022] DELETE /identity/v3/projects/cb531af4ea6b41e0b97a08db51b39fdd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:12:59.830628 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:00.411542 dv-cinder-852209-7-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:01.468666 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:17:01.470090 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:17:01.540387 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685f4ed-eeb0-4564-87e6-3b0795525b21 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:17:01.598065 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3ae11-ffad-489b-845b-7c4276bf6f12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00093949026746f29def86e4a0b48bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a212c6365964553b8566a7edd7b2e5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:17:01.598660 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3ae11-ffad-489b-845b-7c4276bf6f12 service placement] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:17:01.598934 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3ae11-ffad-489b-845b-7c4276bf6f12 service placement] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:17:01.599200 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3ae11-ffad-489b-845b-7c4276bf6f12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:17:01.600959 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-52a3ae11-ffad-489b-845b-7c4276bf6f12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:17:01.612764 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3ae11-ffad-489b-845b-7c4276bf6f12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:17:01.614386 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3ae11-ffad-489b-845b-7c4276bf6f12 service placement] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:17:01.624972 dv-cinder-852209-7-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1443/2914] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 08:17:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:17:11.619976 dv-cinder-852209-7-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=58 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}